VARITE INC · 5 hours ago
Senior Data Engineer
Los Angeles, CA
Full-time
Onsite
Senior Level
$55/hr - $60/hr
7+ years expVARITE INC is a company seeking a Senior Data Engineer to join their team in Los Angeles, CA. The role involves designing and implementing data pipelines and managing cloud-based data solutions, primarily using the Azure ecosystem and various big data technologies.
Information Technology & Services
Responsibilities
Deep understanding of Azure ecosystem, including Azure Data Factory, Data Lake Storage, Blob Storage, power apps, and Functions
In-depth understanding and implementation of API management such as Apigee
Proficiency in Databricks, Spark, PySpark, Scala, and SQL
Expertise in ETL/ELT processes, data pipelines, data modeling, schema design, and data warehousing
Strong Python and SQL skills, with knowledge of other languages like Scala or R beneficial
Strong ERD concepts, designs, and patterns, Understanding of OLAP/OLTP systems, performance tuning, Database Server concepts, and BI tools (Power BI, Tableau)
Strong understanding of RBAC/ABAC, Data Lineage, Data leak prevention, Data security, and compliance
Deep understanding and implementation knowledge of audit and monitoring in Cloud
GitHub version control, CI/CD pipelines, release management, Terraform and YAML templates, and script-based deployments
Qualification
Required
Deep understanding of Azure ecosystem, including Azure Data Factory, Data Lake Storage, Blob Storage, power apps, and Functions
In-depth understanding and implementation of API management such as Apigee
Proficiency in Databricks, Spark, PySpark, Scala, and SQL
Expertise in ETL/ELT processes, data pipelines, data modeling, schema design, and data warehousing
Strong Python and SQL skills, with knowledge of other languages like Scala or R beneficial
Strong ERD concepts, designs, and patterns
Understanding of OLAP/OLTP systems, performance tuning, Database Server concepts, and BI tools (Power BI, Tableau)
Strong understanding of RBAC/ABAC, Data Lineage, Data leak prevention, Data security, and compliance
Deep understanding and implementation knowledge of audit and monitoring in Cloud
GitHub version control, CI/CD pipelines, release management, Terraform and YAML templates, and script-based deployments
Seven (7) years of applying Enterprise Architecture principles, with at least five (5) years in a lead capacity
Five (5) years of hands-on experience with Azure Data Factory, Azure Databricks, API implementation and management solution, and managing Azure resources
Five (5) years of experience in developing data models and pipelines using Python
Five (5) years of experience working with Lakehouse platforms
Five (5) years of experience with GitHub CI/CD pipelines and infrastructure automation, Terraform scripting
Five (5) years of experience with data warehousing systems, OLAP/OLTP systems, and integration of BI tools
Possession of a bachelor's degree in an IT-related or Engineering field
Company
VARITE INC
VARITE has a definite spirit.
1001-5000 employees
Funding
Current Stage
Late StageLeadership Team
Adarsh Katyal
President & CEO
Sue Patel Arora
Vice President Of Strategic Partnerships
Company data provided by crunchbase