SIGN IN
Data Engineering Architect - Azure Databricks, Data lake jobs in United States
cer-icon
Apply on Employer Site
company-logo

Smart IT Frame LLC · 3 hours ago

Data Engineering Architect - Azure Databricks, Data lake

Smart IT Frame is a staffing company that connects top talent with leading organizations across the USA. They are seeking a Data Engineering Architect with strong experience in Azure Databricks and big data technologies to lead data engineering projects and mentor a team.
Business DevelopmentConsultingInformation TechnologyRecruiting
check
H1B Sponsor Likelynote

Responsibilities

Strong experience with Azure Databricks including cluster management notebook development and Delta Lake
Proficiency in big data technologies eg Hadoop Spark and data processing frameworks eg PySpark
Deep understanding of Azure services like Azure Data Lake Azure Synapse and Azure Data Factory
Power BI SSRS SSAS PSKU to F SKU
Experience with ETLELT processes data warehousing and building data lakes
Strong SQL skills and familiarity with NoSQL databases
Experience with CICD pipelines and version control systems like Git
Knowledge of cloud security best practices
Excellent communication skills with the ability to explain complex technical concepts to nontechnical stakeholders
Strong problem solving skills and a proactive approach to identifying and resolving issues
Leadership skills with the ability to manage and mentor a team of data engineers
Nice to have Skills: Power Bl for dashboarding and reporting Strong problem solving skills and a proactive approach to identifying and resolving issues
Leadership skills with the ability to manage and mentor a team of data engineers
Nice to have Skills: Power Bl for dashboarding and reporting
Microsoft Fabric for analytics and integration tasks
Spark Streaming for processing real time data streams
Familiarity with Azure Resource Manager ARM templates for infrastructure as code laC practices

Qualification

Azure DatabricksBig data technologiesAzure servicesETL/ELT processesSQL skillsCICD pipelinesCloud securityPower BIMicrosoft FabricSpark StreamingARM templatesCommunication skillsProblem solving skillsLeadership skills

Required

Strong experience with Azure Databricks including cluster management notebook development and Delta Lake
Proficiency in big data technologies eg Hadoop Spark and data processing frameworks eg PySpark
Deep understanding of Azure services like Azure Data Lake Azure Synapse and Azure Data Factory
Power BI SSRS SSAS PSKU to F SKU
Experience with ETLELT processes data warehousing and building data lakes
Strong SQL skills and familiarity with NoSQL databases
Experience with CICD pipelines and version control systems like Git
Knowledge of cloud security best practices
Excellent communication skills with the ability to explain complex technical concepts to nontechnical stakeholders
Strong problem solving skills and a proactive approach to identifying and resolving issues
Leadership skills with the ability to manage and mentor a team of data engineers

Preferred

Power Bl for dashboarding and reporting
Microsoft Fabric for analytics and integration tasks
Spark Streaming for processing real time data streams
Familiarity with Azure Resource Manager ARM templates for infrastructure as code laC practices

Company

Smart IT Frame LLC

twittertwittertwitter
company-logo
Smart IT Frame is a leading NMSDC-certified staffing partner, founded in 2012 and headquartered in Somerset, New Jersey.

H1B Sponsorship

Smart IT Frame LLC has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (11)
2024 (9)
2023 (11)
2022 (8)
2021 (9)
2020 (9)

Funding

Current Stage
Late Stage

Leadership Team

leader-logo
Murali Kulala
Chief Executive Officer
linkedin

Recent News

Company data provided by crunchbase