Apply on Employer Site

Syren · 1 month ago

Lead Azure Databrick Engineer

Atlanta, GA

Contract

Onsite

Lead/Staff

10+ years exp

Syren is looking for a Lead Azure Databrick Engineer to enhance their data infrastructure. The role involves collaborating with business and IT teams to design and implement data solutions, ensuring efficient data management and architecture.

ComputerSoftware

No H1B

Responsibilities

Designing, implementing, and maintaining the data infrastructure within an organization

Collaborate with both business and IT teams to understand stakeholders’ needs and unlock the full potential of data

Create conceptual and logical data models

Analyze structural requirements

Ensure efficient database solutions

Qualification

DatabricksAzure CloudData StreamingData ModelingBig Data ProjectsData ArchivingCloud ArchitecturesPythonPySparkAnalytical SkillsDebuggingPerformance TuningStructured DataUnstructured DataML ExperienceGraph Analysis

Required

Experience of Migrating from other platform to Databricks

Proficiency in Databricks and Azure Cloud, Databricks Asset Bundles, Hoslistic vision on the Data Strategy

Proficiency in Data Streaming and Data Modeling

Experience in architecting at least two large-scale big data projects

Strong understanding of data scaling and its complexities

Data Archiving and Purging mechanisms

Demonstrable experience in architecture, design, implementation, and/or support of highly distributed applications with Azure cloud and Databricks

10+ Years of Hands-on experience with data modelling, database design, data mining, and segmentation techniques

Working knowledge and experience with 'Cloud Architectures' (e.g., SaaS, PaaS, IaaS) and the ability to address the unique security considerations of secure Cloud computing

Should have architected solutions for Cloud environments such as Microsoft Azure and/or GCP

Experience with debugging and performance tuning in distributed environments

Strong analytical skills with the ability to collect, organize, analyse, and broadcast significant amounts of information with attention to detail and accuracy

Experience dealing with structured, unstructured data

Must have Python, PySpark experience