Senior Data Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Pyramid Technology Solutions · 17 hours ago

Senior Data Engineer

Pyramid Technology Solutions is seeking a Senior Data Engineer to work on a 12-month contract in Los Angeles, CA. The role involves leveraging expertise in Azure and big data technologies to design and implement data pipelines, ensuring data governance and compliance while optimizing data warehousing solutions.

Information TechnologySoftwareStaffing AgencyWeb Apps
check
H1B Sponsor Likelynote
Hiring Manager
Vidya Sagar
linkedin

Responsibilities

Deep understanding of Azure ecosystem, including Azure Data Factory, Data Lake Storage, Blob Storage, power apps, and Functions
Proficiency in Databricks, Spark, PySpark, Scala, and SQL
Expertise in ETL/ELT processes, data pipelines, data modeling, schema design, and data warehousing
Strong Python and SQL skills, with knowledge of other languages like Scala or R beneficial
Strong ERD concepts, designs, and patterns, Understanding of OLAP/OLTP systems, performance tuning, Database Server concepts, and BI tools (Power BI, Tableau)
Strong understanding of RBAC/ABAC, Data Lineage, Data leak prevention, Data security, and compliance
Deep understanding and implementation knowledge of audit and monitoring in Cloud
GitHub version control, CI/CD pipelines, release management, Terraform and YAML templates, and script-based deployments

Qualification

Azure Data FactoryDatabricksETL/ELT processesPythonData GovernanceCI/CD pipelinesTerraformSQLScalaRPower BITableau

Required

Deep understanding of Azure ecosystem, including Azure Data Factory, Data Lake Storage, Blob Storage, power apps, and Functions
In-depth understanding and implementation of API management such as Apigee
Proficiency in Databricks, Spark, PySpark, Scala, and SQL
Expertise in ETL/ELT processes, data pipelines, data modeling, schema design, and data warehousing
Strong Python and SQL skills, with knowledge of other languages like Scala or R beneficial
Strong ERD concepts, designs, and patterns
Understanding of OLAP/OLTP systems, performance tuning, Database Server concepts, and BI tools (Power BI, Tableau)
Strong understanding of RBAC/ABAC, Data Lineage, Data leak prevention, Data security, and compliance
Deep understanding and implementation knowledge of audit and monitoring in Cloud
GitHub version control, CI/CD pipelines, release management, Terraform and YAML templates, and script-based deployments
Seven (7) years of applying Enterprise Architecture principles, with at least five (5) years in a lead capacity
Five (5) years of hands-on experience with Azure Data Factory, Azure Databricks, API implementation and management solution, and managing Azure resources
Five (5) years of experience in developing data models and pipelines using Python
Five (5) years of experience working with Lakehouse platforms
Five (5) years of experience with GitHub CI/CD pipelines and infrastructure automation, Terraform scripting
Five (5) years of experience with data warehousing systems, OLAP/OLTP systems, and integration of BI tools

Company

Pyramid Technology Solutions

twittertwitter
company-logo
Pyramid Technology Solutions helps companies with IT consulting, software development, and professional staffing services.

H1B Sponsorship

Pyramid Technology Solutions has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (75)
2024 (79)
2023 (94)
2022 (56)
2021 (66)
2020 (144)

Funding

Current Stage
Growth Stage

Leadership Team

leader-logo
Ashok Ramanjanappa
Chief Operating Officer
linkedin
Company data provided by crunchbase