Intersec Group · 5 hours ago
Senior Data Engineer
Maximize your interview chances
AnalyticsBig Data
Insider Connection @Intersec Group
Get 3x more responses when you reach out via email instead of LinkedIn.
Responsibilities
Design, build, and maintain scalable and reliable data pipelines to collect, process, and store large datasets from various sources.
Develop and optimize data architecture and data flow processes to support business intelligence and advanced analytics.
Collaborate with data scientists and analysts to understand data needs and implement solutions that ensure data availability and quality.
Implement data security and governance practices to protect sensitive information and comply with regulatory requirements.
Monitor and troubleshoot data pipeline performance to ensure efficiency and minimal downtime.
Integrate structured and unstructured data from various sources, including APIs, databases, and third-party services.
Perform ETL (Extract, Transform, Load) processes and maintain data models for analytics and reporting.
Stay updated on emerging data engineering technologies and practices to recommend system improvements.
Document data architecture, pipelines, and workflows to maintain knowledge continuity.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
Bachelor's degree in Computer Science, Data Engineering, Information Technology, or a related field.
Proven experience as a Data Engineer or in a similar role.
Proficiency in programming languages such as Python, Java, or Scala.
Strong experience with big data tools (e.g., Hadoop, Spark) and data pipeline orchestration frameworks (e.g., Apache Airflow, Luigi).
Expertise in SQL and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB, Cassandra).
Experience with cloud-based data platforms (e.g., AWS, Azure, Google Cloud) and tools like Redshift, Snowflake, or BigQuery.
Familiarity with data warehousing concepts and tools (e.g., Apache Hive, Databricks).
Understanding of data security, governance, and compliance standards.
Strong analytical and problem-solving skills with attention to detail.
Preferred
Experience with containerization and orchestration tools (e.g., Docker, Kubernetes).
Familiarity with machine learning pipelines and MLOps practices.
Knowledge of real-time data streaming tools like Apache Kafka or AWS Kinesis.
Certifications in cloud platforms or data engineering technologies (e.g., AWS Certified Data Analytics, Google Professional Data Engineer).
Company
Intersec Group
Intersec is a global pioneer in mobile data and location intelligence solutions.