CloudIngest · 6 hours ago
Azure Data Factory (ADF) Engineer - 10+ // OPT visa works only w2
North Carolina, United States
Contract
Onsite
Senior Level, Lead/Staff
10+ years expCloudIngest is a company focused on data solutions, and they are seeking an Azure Data Factory Engineer to manage data ingestion and optimization tasks. The role involves implementing best practices for Azure Data Factory, optimizing PySpark jobs, and working with various data storage solutions like Snowflake and Azure Databricks.
Business IntelligenceInformation TechnologySoftware
No H1B
Hiring Manager
Sohini Guha Roy
Responsibilities
Data ingestion using Azure Data Factory (ADF)
Azure Data Factory (ADF) best practices
Azure SQL, TensorFlow, PySpark
Data Skew and fixing Data Skew
Optimizing PySpark Jobs and PySpark junction/join
Azure Databricks
Snowflake
Star Schema
Difference between Snowflake and Star Schema
Scenarios where the candidate was able to identify Data Clusters in DataBricks without effecting performance
Schema Drift
Contextual data embedding and Model embedding
Detect Bias Transformation
Data cleaning
Qualification
Required
Data ingestion using Azure Data Factory (ADF)
Azure Data Factory (ADF) best practices
Azure SQL, TensorFlow, PySpark
Data Skew and fixing Data Skew
Optimizing PySpark Jobs and PySpark junction/join
Azure Databricks
Snowflake
Star Schema
Difference between Snowflake and Star Schema
Scenarios where the candidate was able to identify Data Clusters in DataBricks without effecting performance
Schema Drift
Contextual data embedding and Model embedding
Detect Bias Transformation
Data cleaning
Company
CloudIngest
CloudIngest offers software development, digital Transformations, business intelligence, and cloud services.
11-50 employees
Funding
Current Stage
Early StageLeadership Team
Siddartha .
Talent Acquisition Partner
Company data provided by crunchbase