CloudIngest ยท 6 hours ago
Databricks Data Architect
Maximize your interview chances
Insider Connection @CloudIngest
Get 3x more responses when you reach out via email instead of LinkedIn.
Responsibilities
Design and implement scalable data pipelines using Databricks and PySpark .
Develop and optimize data models, ensuring alignment with medallion architecture (Bronze, Silver, Gold layers).
Integrate data from various sources into Snowflake and other cloud platforms.
Build and manage ETL/ELT processes to support real-time and batch data processing.
Collaborate with data engineers, analysts, and business teams to deliver end-to-end data solutions.
Ensure data quality, security, and governance standards are maintained.
Troubleshoot and resolve performance and scalability issues within data pipelines.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
Proven experience with Databricks and PySpark for data processing and pipeline development.
Knowledge of Snowflake and its integration within cloud ecosystems.
Strong expertise in data modeling and implementing medallion architecture.
Hands-on experience in designing ETL/ELT workflows.
Familiarity with cloud platforms (AWS, Azure, or GCP).
Excellent problem-solving skills and ability to work collaboratively in cross-functional teams.
Company
CloudIngest
CloudIngest offers software development, digital Transformations, business intelligence, and cloud services.
H1B Sponsorship
CloudIngest has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (12)
2022 (4)
2021 (4)
2020 (7)
Funding
Current Stage
Early StageCompany data provided by crunchbase