Miracle Software Systems, Inc ยท 2 days ago
Senior Data Engineer
Wonder how qualified you are to the job?
B2BBig Data
Insider Connection @Miracle Software Systems, Inc
Responsibilities
Design, develop, and implement end-to-end data pipelines using Azure Data Factory for ETL processes.
Develop Azure data pipelines integrating SAP as data source and data lake as target.
Ensure scalability, reliability, and alignment with business requirements.
Utilize Azure Databricks for big data processing and optimization.
Collaborate with data scientists and analysts to enhance data workflows.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
Strong understanding of Data Storage, Structures, Processing, and Security.
Proficiency in Python, Java, or Scala, and Hadoop (mandatory).
Experience with Lakehouse architecture, specifically Microsoft fabric.
Knowledge of SAP ecosystem, including ECC and BW.
Preferred
Experience in distributed systems, Apache Hadoop, and Apache Spark.
Ability to solve complex problems independently and recommend efficiency solutions.
Agile methodology experience (Scrum/Kanban).
Collaboration within cross-functional Agile teams.
Company
Miracle Software Systems, Inc
Miracle Software Systems is a global IT services company that has been consistently delivering true value for businesses for the past 29 years.
H1B Sponsorship
Miracle Software Systems, Inc has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Trends of Total Sponsorships
2023 (115)
2022 (182)
2021 (149)
2020 (195)
Funding
Current Stage
Late StageCompany data provided by crunchbase