JobsPassport ยท 4 months ago
Microsoft Fabric Data Engineer
JobsPassport is seeking a Microsoft Fabric Data Engineer to design and implement data storage systems using Azure services. The role involves developing data integration processes, utilizing big data technologies, and optimizing data pipelines for analytics and machine learning applications.
Computer Software
Responsibilities
Design and implement data storage systems using Azure services like Azure SQL Database, Azure Data Lake Storage, and Azure Synapse
Ensure scalability, performance, and cost-effectiveness
Develop and implement data integration processes using Azure Data Factory
Extract data from various sources, transform it, and load it into data warehouses or data lakes
Utilize big data technologies such as Apache Spark
Create data processing workflows and pipelines to support data analytics and machine learning applications
Build and maintain new and existing applications in preparation for a large-scale architectural migration within an Agile function
Monitor and optimize data pipelines and database performance to ensure data processing efficiency
Build interfaces for supporting evolving and new applications and accommodating new data sources and types of data
Document data engineering processes, data models, and pipelines to ensure transparency and maintainability
Qualification
Required
Bachelor's degree Computer Science or a related field
5+ years of experience in building data and analytics platform focused on Azure data and analytics solutions
Expertise in Azure services such as Azure SQL Database, Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake
Proficiency in software development and scripting languages
Proficiency in ETL tools (e.g., SSIS, Azure Data Factory, Power BI Dataflow)
Proficiency in database management (MSSQL, Azure SQL Database, Azure Data Lake Storage, and Azure Synapse)
Knowledge of data modeling and data warehousing concepts
Excellent problem-solving and troubleshooting abilities
Attention to detail and commitment to data accuracy
Experience with cloud-based data migration
Strong analytical and problem-solving skills, with ability to conduct root cause analysis on system, process or production problems and ability to provide viable solutions
Experience working in an Agile environment with Scrum Master/Product owner and ability to deliver
3+ years of programming experience in Python/Pyspark
7+ years of experience in Microsoft Azure
Knowledge of Jira, Confluence, SAFe development methodology & DevOps
Company
JobsPassport
JobsPassport Breaking barriers, connecting talents worldwide! Jobs Passport is a one-stop international recruitment portal that connects potential talent with business organizations looking forward to building a diverse, inclusive & competitive workforce with global talent.
Funding
Current Stage
Early StageCompany data provided by crunchbase