Rearc ยท 2 days ago
Senior Data Engineer
Wonder how qualified you are to the job?
ConsultingInformation Technology
Insider Connection @Rearc
Responsibilities
Strategic Data Engineering Leadership: Provide strategic vision and technical leadership in data engineering, guiding the development and execution of advanced data strategies that align with business objectives.
Architect Data Solutions: Design and architect complex data pipelines and scalable architectures, leveraging advanced tools and frameworks (e.g., Apache Kafka, Kubernetes) to ensure optimal performance and reliability.
Drive Innovation: Lead the exploration and adoption of new technologies and methodologies in data engineering, driving innovation and continuous improvement across data processes.
Technical Expertise: Apply deep expertise in ETL processes, data modeling, and data warehousing to optimize data workflows and ensure data integrity and quality.
Collaboration and Mentorship: Collaborate closely with cross-functional teams to understand requirements and deliver impactful data solutions. Mentor and coach junior team members, fostering their growth and development in data engineering practices.
Thought Leadership: Contribute to thought leadership in the data engineering domain through technical articles, conference presentations, and participation in industry forums.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
8+ years in data engineering, with proven experience across various architectures, technology stacks, and use cases.
Expertise in designing and implementing data warehouse and lake architectures.
Extensive experience in writing and testing Python and or Java. Familiarity with libraries such as Requests, Selenium, and Luigi is a plus.
Proven experience with data pipeline orchestration platforms such as Airflow, Prefect, or AWS Glue.
Hands-on experience with data analysis tools like NumPy, Pandas, Dask etc.
Proficiency with Spark, Databricks, or EMR is a major plus.
Experience with SQL and NoSQL databases and data warehouses, including Postgres, RedShift, Delta Lake, and DynamoDB.
In-depth knowledge of data architecture principles and best practices.
Proven experience with cloud services on AWS, GCP, or Azure. Proficient in using CLI, SDK, and Infrastructure as Code (IaC) tools.
Experience with IaC tools such as Terraform, CloudFormation, or AWS CDK.
Exceptional communication skills, with the ability to articulate complex technical concepts to both technical and non-technical stakeholders.
Demonstrated ability to quickly adapt to new tasks and roles in a dynamic environment.
Preferred
Proficiency with Spark, Databricks, or EMR is a major plus.
Experience with IaC tools such as Terraform, CloudFormation, or AWS CDK.
Company
Rearc
Rearc IT consulting firm that engages in cloud technology.
H1B Sponsorship
Rearc has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Trends of Total Sponsorships
2023 (2)
2021 (3)
Funding
Current Stage
Growth StageLeadership Team
Company data provided by crunchbase