Phaxis ยท 18 hours ago
Senior Data Engineer
Phaxis is seeking a Senior Data Engineer to join their dynamic data team. The ideal candidate will have hands-on experience designing, building, and optimizing enterprise-scale data pipelines and reporting solutions.
DeliveryHuman ResourcesStaffing Agency
Responsibilities
Design, develop, and maintain robust ETL pipelines using SSIS, Azure Data Factory (ADF), and other Azure services
Build, optimize, and maintain SQL Server, Azure SQL, and Snowflake databases for analytical and operational reporting
Transform large datasets using Databricks, PySpark, and Delta Lake to deliver unified data models
Collaborate with cross-functional teams to implement datamarts, tabular models, and reporting solutions using Power BI
Automate pipeline monitoring, error handling, and data validation to ensure data quality and reliability
Optimize SQL queries, execution plans, and ETL processes to improve performance and reduce costs
Participate in CI/CD deployment pipelines using Azure DevOps and version control tools like Git
Integrate and process data from various APIs, cloud sources, and third-party platforms, including interacting with web service APIs (SOAP, REST)
Mentor junior engineers and provide guidance on best practices in ETL, data modeling, and pipeline optimization
Qualification
Required
Bachelor's or Master's degree in Computer Science, Information Technology, or a related field
5+ years of experience in data engineering, ETL, and data pipeline development
Strong expertise in SQL, SSIS, ETL, and Azure Data Factory
Hands-on experience with Azure Synapse, Databricks, Python, Spark, and cloud-based data warehousing
Experience in data modeling, tabular modeling, and building analytical reporting solutions
Knowledge of Python/PySpark for data transformation and automation
Experience interacting with web service APIs (SOAP, REST)
Familiarity with Snowflake, Delta Lake, or other cloud data platforms is a plus
Java or Groovy experience is a plus
Strong problem-solving, analytical thinking, and cross-team collaboration skills
Preferred
Experience with Power BI, API integration, and data visualization
Familiarity with CI/CD pipelines and automated deployment processes
Knowledge of data governance, data quality, and monitoring best practices