PETADATA ยท 13 hours ago
Senior Data Lake Engineer
Dallas, TX
Full-time
Hybrid
Senior Level, Lead/Staff
15+ years expPETADATA is seeking a seasoned Senior Data Lake Engineer with over 15 years of experience in data engineering and a strong focus on building and managing AWS-native Data Lake solutions. The ideal candidate will have deep expertise with AWS Lake Formation and serverless data processing using Lambda and Python.
Information TechnologyMobile AppsProject ManagementSoftware
Responsibilities
Design, build, and optimize scalable, secure data lakes using AWS Lake Formation and best practices for data governance, cataloging, and access control
Build and deploy AWS Lambda functions using Python for real-time data processing, automation, and event-driven workflows
Develop and maintain robust data pipelines using AWS Glue, integrating data from various structured and unstructured sources
Leverage AI-powered coding tools (such as Amazon Q, GitHub Copilot, or similar) to increase development speed, code quality, and automation
Design and implement integrations between the Data Lake and DynamoDB, optimizing for performance, scale, and consistency
Implement fine-grained access control using Lake Formation, IAM policies, encryption, and data masking techniques to meet enterprise and compliance standards (e.g., GDPR, HIPAA)
Implement logging, monitoring, and performance tuning for Glue jobs, Lambda functions, and data workflows
Collaborate with cross-functional teams including data science, analytics, DevOps, and product teams. Provide mentorship and technical leadership to junior engineers
Qualification
Required
15+ years in data engineering roles, with 5+ years focused on AWS-native data lake development
Deep, hands-on expertise in AWS Lake Formation, Glue, Lambda, and DynamoDB
Proficient in Python, especially for serverless and data processing applications
Experience using AI-assisted development tools (e.g., Amazon Q, GitHub Copilot, AWS CodeWhisperer)
Strong knowledge of data security practices in AWS, including IAM, encryption, and compliance standards
Experience with workflow orchestration tools such as Step Functions, Airflow, or custom AWS-based solutions
Strong communication, problem-solving, and collaboration skills. Able to lead discussions on architecture and best practices
Preferred
AWS Certifications (e.g., AWS Certified Data Analytics, AWS Certified Solutions Architect)
Experience with Athena, Redshift, or other analytics services in the AWS ecosystem
Exposure to DevOps practices and tools like Terraform, CloudFormation, or CDK
Familiarity with data cataloging and metadata management tools
Company
PETADATA
PETADATA is an Information Technology & Services company that specializes in delivering technology solutions to meet the needs of our clients.
51-200 employees
H1B Sponsorship
PETADATA has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2024 (10)
2023 (6)
2022 (13)
2021 (5)
2020 (12)
Funding
Current Stage
Growth StageLeadership Team
R
Ravi Kumar
Founder and President
Company data provided by crunchbase