Smart IT Frame LLC · 3 hours ago
Data Engineering Architect - Azure Databricks, Data lake
Smart IT Frame is a staffing company that connects top talent with leading organizations across the USA. They are seeking a Data Engineering Architect with strong experience in Azure Databricks and big data technologies to lead data engineering projects and mentor a team.
Business DevelopmentConsultingInformation TechnologyRecruiting
Responsibilities
Strong experience with Azure Databricks including cluster management notebook development and Delta Lake
Proficiency in big data technologies eg Hadoop Spark and data processing frameworks eg PySpark
Deep understanding of Azure services like Azure Data Lake Azure Synapse and Azure Data Factory
Power BI SSRS SSAS PSKU to F SKU
Experience with ETLELT processes data warehousing and building data lakes
Strong SQL skills and familiarity with NoSQL databases
Experience with CICD pipelines and version control systems like Git
Knowledge of cloud security best practices
Excellent communication skills with the ability to explain complex technical concepts to nontechnical stakeholders
Strong problem solving skills and a proactive approach to identifying and resolving issues
Leadership skills with the ability to manage and mentor a team of data engineers
Nice to have Skills: Power Bl for dashboarding and reporting Strong problem solving skills and a proactive approach to identifying and resolving issues
Leadership skills with the ability to manage and mentor a team of data engineers
Nice to have Skills: Power Bl for dashboarding and reporting
Microsoft Fabric for analytics and integration tasks
Spark Streaming for processing real time data streams
Familiarity with Azure Resource Manager ARM templates for infrastructure as code laC practices
Qualification
Required
Strong experience with Azure Databricks including cluster management notebook development and Delta Lake
Proficiency in big data technologies eg Hadoop Spark and data processing frameworks eg PySpark
Deep understanding of Azure services like Azure Data Lake Azure Synapse and Azure Data Factory
Power BI SSRS SSAS PSKU to F SKU
Experience with ETLELT processes data warehousing and building data lakes
Strong SQL skills and familiarity with NoSQL databases
Experience with CICD pipelines and version control systems like Git
Knowledge of cloud security best practices
Excellent communication skills with the ability to explain complex technical concepts to nontechnical stakeholders
Strong problem solving skills and a proactive approach to identifying and resolving issues
Leadership skills with the ability to manage and mentor a team of data engineers
Preferred
Power Bl for dashboarding and reporting
Microsoft Fabric for analytics and integration tasks
Spark Streaming for processing real time data streams
Familiarity with Azure Resource Manager ARM templates for infrastructure as code laC practices
Company
Smart IT Frame LLC
Smart IT Frame is a leading NMSDC-certified staffing partner, founded in 2012 and headquartered in Somerset, New Jersey.
H1B Sponsorship
Smart IT Frame LLC has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (11)
2024 (9)
2023 (11)
2022 (8)
2021 (9)
2020 (9)
Funding
Current Stage
Late StageRecent News
2025-07-01
2025-06-30
Tech Startups - Startups and Technology news
2025-06-27
Company data provided by crunchbase