200+ applicants

Company

Original Job Post

PA Consulting · 2 days ago

Data Engineer

Boston, MA

Full-time

Hybrid

Mid Level

$90K/yr - $125K/yr

Wonder how qualified you are to the job?

Maximize your interview chances

Business DevelopmentConsulting

H1B Sponsorship

Insider Connection @PA Consulting

Discover valuable connections within the company who might provide insights and potential referrals, giving your job application an inside edge.

Responsibilities

Design and construct Big Data Lakes and Data Warehouses capable of ingesting, standardizing, and serving billions of data rows from diverse datasets.

Build dynamic, metadata-driven pipelines and analyses.

Develop and manage fully automated data pipelines (ETL, ELT, ELTL) including designing data interfaces to source systems, transforming data for storage, developing datasets for analytics, and creating pipelines that handle common issues/errors in a robust and automated manner.

Utilize cloud platforms such as Azure, AWS, or GCP for data engineering tasks.

Leverage Spark / PySpark for data processing (preferred).

Work in Agile and DevOps environments.

Use Python, Bash, or PowerShell for automation.

Implement data modelling techniques like Kimball, Data Vault, Star/Snowflake schema, and more.

Visualize data using tools like Power BI, Tableau, or Qlik.

Architect Data Platforms by designing BI/MI/Analytics solutions using various data technologies.

Obtain relevant certifications such as Microsoft Certified: Azure Data Engineer Associate, AWS Certified Data Analytics - Specialty, or GCP Professional Data Engineers.

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

SQLPythonBig DataData WarehousesData LakesETLELTELTLData PipelinesData InterfacesData TransformationCloud ComputingAzureAWSGCPSpark/PySparkAgileDevOpsBashPowerShellData ModellingKimballData VaultStar/Snowflake SchemaData VisualisationPower BITableauQlikArchitecting Data PlatformsBI

Required

Advanced SQL and Python

Expertise in the design and construction of Big Data Lakes and Data Warehouses capable of ingesting, standardizing, and serving billions of data rows spanning diverse datasets ranging from tens to hundreds

Experience building dynamic, metadata driven pipelines and analyses

Building and managing fully automated data pipelines (ETL, ELT, ELTL) including: Designing and building data interfaces to source systems, Combining and transforming data into the appropriate format for storage, Developing data sets for analytics purposes, Developing pipelines that can handle common issues/errors in a robust and automated way

Cloud experience in Azure, AWS or GCP

Preferred

Spark / PySpark experience highly preferable

Working in Agile and DevOps environments

Basic Python, Bash, or PowerShell for automation

Data modelling – Kimball, Data Vault, Star/Snowflake schema, Query-first etc.

Data visualisation in Power BI, Tableau, Qlik or similar

Architecting Data Platforms - designing BI/MI/Analytics solutions using Big Data, Relational or Streaming technologies

One or more of the following certifications: Microsoft Certified: Azure Data Engineer Associate, AWS Certified Data Analytics - Specialty, GCP Professional Data Engineers

Company

PA Consulting

Glassdoor

3.7

We believe in the power of ingenuity to build a positive human future.

Founded in 1943

London, England, GBR

1,001-5,000 employees

http://www.paconsulting.com/

H1B Sponsorship

PA Consulting has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Trends of Total Sponsorships

2023 (5)

2022 (9)

2021 (10)

2020 (10)