200+ applicantsPosted by Agency

Company

Pyramid Consulting, Inc · 1 day ago

Senior Data Engineer

United States

Contract

Remote

Senior Level, Lead/Staff

$80/hr - $100/hr

10+ years exp

Maximize your interview chances

ConsultingInformation Technology

Growth Opportunities

H1B Sponsor Likely

Insider Connection @Pyramid Consulting, Inc

Discover valuable connections within the company who might provide insights and potential referrals.
Get 3x more responses when you reach out via email instead of LinkedIn.

Responsibilities

Lead a team of data engineers, providing mentorship, setting priorities, and ensuring alignment with business goals.

Implement and optimize data pipelines with AWS.

Develop modern data pipelines using AWS Step functions, Prefect, Airflow, Luigi, Python, Spark, SQL.

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

Data ModelingDatabricksAWSPythonData Pipeline DevelopmentAWS Step FunctionsPrefectAirflowLuigiSparkSQLPySparkAWS Certified Data EngineerAWS Certified Solutions ArchitectDistributed File SystemsS3HDFCADLSHUDIIcebergJSONParquetCsvSnowflakeMS SQL Server

Required

Data engineer with data modeling, Databricks, AWS, Python.

10 years of experience.

Extensive hands-on data system design and coding experience.

Development of modern data pipelines (AWS Step functions, Prefect, Airflow, Luigi, Python, Spark, SQL) and associated code in AWS.

Able to Lead a team of data engineers, providing mentorship, setting priorities, and ensuring alignment with business goals.

Experience implementing and optimizing data pipelines with AWS.

Strong programming experience in PySpark, SQL, Python.

AWS, preferably AWS certified Data Engineer and AWS certified Solutions Architect.

Working experience with distributed file systems (S3, HDFC, ADLS), table formats (HUDI, Iceberg), and various open file formats (JSON, Parquet, Csv, etc.).

Snowflake/ Databricks / Synapse / MS SQL Server.

Benefits

Health insurance (medical, dental, vision)

401(k) plan

Paid sick leave (depending on work location)

Company

Pyramid Consulting, Inc

Glassdoor

4.2

Pyramid Consulting, a global leader in workforce and technology solutions, empowers individuals and organizations to transform and thrive in the most challenging and competitive markets.

Founded in 1996

Alpharetta, Georgia, USA

5,001-10,000 employees

https://pyramidci.com/

H1B Sponsorship

Pyramid Consulting, Inc has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2023 (77)

2022 (60)

2021 (62)

2020 (93)