42 applicants

Company

Original Job Post

3Pillar Global · 1 week ago

Senior Data Engineer

Full-time

Hybrid

Senior Level

5+ years exp

Wonder how qualified you are to the job?

AndroidConsulting

H1B Sponsorship

Actively Hiring

Work & Life Balance

Insider Connection @3Pillar Global

Discover valuable connections within the company who might provide insights and potential referrals, giving your job application an inside edge.

Responsibilities

Understanding the business requirements.

Writing code and implementing the proposed solutions.

Creating data pipelines, versioning, and change management.

Managing the complexity inherent in data pipelines.

Developing ETL/ELT processes to help extract and manipulate data from multiple sources.

Designing, building, and maintaining batch or data pipelines in production.

Automating data workflows such as data ingestion, aggregation, and ETL processing.

Logging and instrumentation of pipelines and services.

Ensuring data accuracy, integrity, privacy, security, and compliance through quality control procedures.

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

SQLDatabase DesignCloud Data WarehousePythonBig Data TechnologiesData Pipeline ManagementAirflowData VisualizationAWS/Azure/GCP ServicesAWS ServicesData LakesData WarehousesProblem-SolvingCommunicationOrganizationalTeamwork

Required

Demonstrated expertise with a minimum of 5+ years of experience as data engineer or similar role.

Advanced SQL skills and experience with relational databases and database design.

Experience working with cloud Data Warehouse solutions (e.g., Snowflake, DataBricks, Redshift, BigQuery, Azure Synapse, etc.)

Python skills with hands-on experience Experience with Big Data technologies like Spark, Map Reduce, Hadoop, Hive etc.

Proficient in data pipeline and workflow management tools e.g. Airflow

Experience with data visualization tools like PowerBI, Tableau, AWS QuickSight etc.

Experience with the AWS/Azure/GCP data engineering services

Knowledge of AWS services viz., DMS, S3, Lambda, EMR, GLUE ETL, Athena, RDS, Redshift, EC2, IAM (or associate Azure services)

Very good exposure of working on Data Lakes & Data Warehouses solutions

Excellent problem-solving, communication, and organizational skills.

Proven ability to work independently and with a team.

Ability to guide other data engineers.

Company

3Pillar Global

Glassdoor

3.6

3Pillar Global is a software product development company providing solutions in the areas of mobile applications and SaaS-based enablement.

Founded in 2006

Fairfax, Virginia, USA

1,001-5,000 employees

http://www.3pillarglobal.com

H1B Sponsorship

3Pillar Global has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Trends of Total Sponsorships

2021 (1)