Padmore Global Connections ยท 5 months ago
Data Architect (Microsoft Fabric & Azure Databricks)
Atlanta, Georgia, United States
Full-time
Hybrid
Senior Level
6+ years expPadmore Global Connections is seeking an experienced Data Architect to design and implement enterprise data solutions using Microsoft Fabric and Azure Databricks. This role will focus on creating scalable data architecture and ensuring seamless data flow between IES Gateway and the analytics platform, while also establishing data governance frameworks and security patterns.
Information Technology & Services
Responsibilities
Design end-to-end data architecture leveraging Microsoft Fabric's capabilities
Design data flows within the Microsoft Fabric environment
Implement OneLake storage strategies
Configure Synapse Analytics workspaces
Establish Power BI integration patterns
Architect data integration patterns between IES Gateway and the analytics platform using Azure Databricks and Microsoft Fabric
Design Delta Lake architecture for IES Gateway data
Implement medallion architecture (Bronze/Silver/Gold layers)
Create real-time data ingestion patterns
Establish data quality frameworks
Implement modern data lakehouse architecture using Delta Lake, ensuring data reliability and performance
Establish data governance frameworks incorporating Microsoft Purview for data quality, lineage, and compliance
Implement row-level security
Configure Microsoft Purview policies
Establish data masking for sensitive information
Design audit logging mechanisms
Design scalable data pipelines using Azure Databricks for ETL/ELT processes and real-time data integration
Implement performance tuning strategies for large-scale data processing and analytics workloads
Optimize Spark configurations
Implement partitioning strategies
Design caching mechanisms
Establish monitoring frameworks
Design and implement security patterns aligned with federal and state requirements for sensitive data handling
Qualification
Required
Bachelors degree in computer science or related field
6+ years of experience in data architecture and engineering
2+ years hands-on experience with Azure Databricks and Spark
Recent experience with Microsoft Fabric platform
Data Integration: Combining and cleansing data from various sources
Data Pipeline Management: Creating, orchestrating, and troubleshooting data pipelines
Analytics Reporting: Building and delivering detailed reports and dashboards to derive meaningful insights from large datasets
Data Visualization Techniques: Representing data graphically in impactful and informative ways
Company
Padmore Global Connections
Padmore Global Connections LLC (PGC) is a premier provider of cutting-edge technology and project management solutions with locations in North Brunswick NJ, Medford MA, Herndon VA and Monroe NC.
2-10 employees
Funding
Current Stage
Early StageLeadership Team
Eric Ayim, B. Acc., PMP
CFO & Co-Founder
Company data provided by crunchbase