Lead Big Data Engineer - PySpark jobs in United States
cer-icon
Apply on Employer Site
company-logo

Logic20/20, Inc. · 1 day ago

Lead Big Data Engineer - PySpark

Logic20/20, Inc. is a recognized leader in providing innovative solutions, focusing on collaboration and client satisfaction. As a Lead Big Data Engineer, you will be responsible for delivering client value through data assessment, analysis, and the development of CI/CD pipelines while effectively communicating with both business and technology teams.

ConsultingInformation TechnologyLegal
check
H1B Sponsor Likelynote

Responsibilities

Perform data assessment, analysis, and data model design
Develop CI/CD pipelines and other DataOps fundamentals
Communicate at the appropriate level to both business and technology teams to understand business needs and pain points
Be creative in meeting the client’s core needs with their technology
Explain technical benefits and deficits to non-technical audiences

Qualification

PythonPySparkCloud ETLCI/CD pipelinesBig Data TechnologiesFlinkKafkaKubernetesAzureAWSGCPJavaConsulting experienceUtilities industry experience

Required

5-10+ years of data engineering experience using Python and Spark (PySpark)
2+ years of experience leading the design and development of cloud ETL and data pipelines
Experience working with fast streaming data
Experience with Flink, Kafka, and Kubernetes
Experience developing CI/CD pipelines
Experience with Big Data Technologies (Hadoop, Spark/PySpark, MongoDB)
Experience working with Azure, AWS, and/or GCP
Demonstrated ability to identify business and technical impacts of user requirements and incorporate them into the project schedule
Ability to travel at least once per quarter

Preferred

Extensive experience working with Palantir Foundry
Java experience is highly preferred
Consulting experience and/or experience working within the Utilities industry is highly preferred

Benefits

Performance-based bonuses and other incentives

Company

Logic20/20, Inc.

company-logo
Headquartered in Seattle with offices nationwide, we've been helping clients address their toughest challenges—and achieve their most ambitious goals—since 2005.

H1B Sponsorship

Logic20/20, Inc. has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (2)
2024 (2)
2023 (6)
2022 (2)
2021 (3)
2020 (5)

Funding

Current Stage
Growth Stage

Leadership Team

leader-logo
Christian O'Meara
CEO
linkedin
Company data provided by crunchbase