Incedo Inc. · 1 day ago
Senior Data Engineer
Fort Mill, SC
Contract
Remote
Senior Level, Lead/Staff
10+ years exp
Maximize your interview chancesAnalyticsConsulting
Hiring Manager
Abhishek Bhatia
Insider Connection @Incedo Inc.
Get 3x more responses when you reach out via email instead of LinkedIn.
Responsibilities
Designed and implemented scalable data pipelines and ETL processes using AWS services like Lambda, Glue, and other serverless technologies.
Develop and maintain data transformation scripts using Python and PySpark.
Manage and optimize data storage and access on AWS (e.g., S3, DynamoDB, or Redshift).
Write and maintain Terraform scripts for deploying and managing cloud infrastructure.
Ensure data pipelines are robust, performant, and secure to meet business requirements.
Collaborate with cross-functional teams, including data scientists, analysts, and DevOps, to ensure seamless integration.
Monitor and troubleshoot data pipeline issues, ensuring high availability and reliability.
Stay updated with emerging AWS tools and best practices for data engineering and cloud infrastructure.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
Bachelor’s degree in Computer Science, Engineering, or a related field.
10+ years of experience in data engineering with hands-on expertise in AWS Glue services like (Triggers, Glue Workflows, Glue Streaming, Glue Studio, Glue Crawlers).
Proficiency in Python and PySpark for data processing and transformations.
Experience with AWS serverless technologies like Lambda, Glue, and Step Functions.
Strong experience with Terraform for Infrastructure as Code (IaC).
Solid understanding of cloud-based data storage and compute services.
Experience with CI/CD pipelines and version control systems (e.g., Git).
Knowledge of data modeling, schema design, and optimization techniques.
Preferred
AWS certifications (e.g., AWS Certified Data Analytics – Specialty or AWS Certified Solutions Architect).
Experience with other data tools like Apache Airflow or Snowflake.
Familiarity with DevOps practices and tools such as Docker and Kubernetes.
Understanding of data governance and security best practices.
Company
Incedo Inc.
Incedo is a New Jersey headquartered, digital, data analytics and technology services firm.
1,001-5,000 employees
H1B Sponsorship
Incedo Inc. has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (83)
2022 (117)
2021 (53)
2020 (67)
Funding
Current Stage
Late StageLeadership Team
Naresh Ayyala
SVP, Carrier Sales
Recent News
Company data provided by crunchbase
