ConglomerateIT ยท 9 hours ago
Data Engineer
United States
Contract
Remote
Senior Level, Lead/Staff
10+ years exp
Maximize your interview chancesInformation Technology & Services
No H1B
Insider Connection @ConglomerateIT
Get 3x more responses when you reach out via email instead of LinkedIn.
Responsibilities
Design, develop, and optimize scalable data pipelines to support data processing and analytics.
Work closely with data scientists, analysts, and other stakeholders to ensure data needs are met efficiently.
Build and maintain data architectures, including databases, data warehouses, and data lakes.
Integrate new data sources into the existing infrastructure and ensure high-quality data management practices.
Optimize data storage and retrieval processes, ensuring minimal latency and maximum performance.
Develop and maintain data pipelines that allow for real-time or batch processing.
Troubleshoot and resolve data pipeline issues, ensuring the integrity and availability of data.
Implement best practices for data security, quality, and privacy.
Participate in code reviews and mentor junior engineers to ensure high-quality development standards.
Stay current on industry trends and emerging technologies to continually improve data infrastructure.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
Minimum of 10+ years of hands-on experience in data engineering.
Strong expertise in SQL, NoSQL, and data modeling.
Proficiency in ETL/ELT processes and tools (e.g., Apache Airflow, Talend, or similar).
Extensive experience with cloud platforms like AWS, Azure, or Google Cloud, including services such as S3, Redshift, BigQuery, or similar.
Strong knowledge of Python, Java, or Scala for building data pipelines and automation scripts.
Familiarity with streaming data platforms (e.g., Kafka, Kinesis) is a plus.
Knowledge of data warehousing and experience working with technologies such as Snowflake, Redshift, or Google BigQuery.
Understanding of containerization and orchestration tools (e.g., Docker, Kubernetes).
Experience with CI/CD practices and tools (e.g., Jenkins, GitLab).
Familiarity with DevOps practices and infrastructure-as-code tools (e.g., Terraform, CloudFormation).
Ability to work with large-scale data sets, distributed systems, and performance optimization techniques.
Strong analytical and problem-solving abilities.
Excellent communication skills to collaborate with cross-functional teams and stakeholders.
Ability to mentor and guide junior team members in best practices.
Detail-oriented with a strong focus on data accuracy and integrity.
Ability to work independently and manage multiple projects simultaneously in a fast-paced, dynamic environment.
Company
ConglomerateIT
ConglomerateIT is a certified and a pioneer in providing premium end-to-end Global Workforce Solutions and IT Services to diverse clients across various domains.
201-500 employees
Funding
Current Stage
Growth StageCompany data provided by crunchbase
