Transcend Softech LLC · 12 hours ago
Data Engineer
Irvine, CA
Contract
Onsite
Mid LevelTranscend Softech LLC is seeking a Data Engineer to join their team. The role involves working on data engineering and architecture, focusing on tools like Databricks and dbt, while also ensuring data governance and security.
Information Technology & Services
No H1B
Responsibilities
Strong experience in Databricks (Lakehouse, spark, delta tables)
Expertise in dbt for data modeling, transformations and testing
Proficiency in airflow for orchestration and scheduling pipelines
Solid understanding of data ingestion patterns (batch, streaming, MFT file handling)
Knowledge of data lineage, Governance and Security (AD groups, RBAC)
Hands on AWS preferred Databricks with AWS
Familiarity with CI/CD for data workflows (Databricks with Active bundle deployments)
Docker and Kubernetes Containerization Experience
Python (Airflow DAGS, Databricks notebooks)
SQL (advanced dbt models and transformations with jinja notation)
Qualification
Required
Strong experience in Databricks (Lakehouse, spark, delta tables)
Expertise in dbt for data modeling, transformations and testing
Proficiency in airflow for orchestration and scheduling pipelines
Solid understanding of data ingestion patterns (batch, streaming, MFT file handling)
Knowledge of data lineage, Governance and Security (AD groups, RBAC)
Hands on AWS preferred Databricks with AWS
Familiarity with CI/CD for data workflows (Databricks with Active bundle deployments)
Docker and Kubernetes Containerization Experience
Python (Airflow DAGS, Databricks notebooks)
SQL (advanced dbt models and transformations with jinja notation)
Company
Transcend Softech LLC
Transcend Softech llc is a leading Manpower Solutions and IT Consulting firm with over 10 years of industry experience.
Founded in 2014
51-200 employees
Funding
Current Stage
Growth StageCompany data provided by crunchbase