Harness · 4 days ago
Senior Data Engineer
Wonder how qualified you are to the job?
Developer ToolsDevOps
Insider Connection @Harness
Responsibilities
Design, build, and maintain scalable data pipelines and infrastructure to support data ingestion, processing, and storage.
Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and develop solutions to meet business needs.
Implement data quality checks and ensure data integrity and reliability throughout the data lifecycle.
Optimize and tune data pipelines for performance and efficiency.
Troubleshoot and debug data-related issues, and provide timely resolution.
Stay updated with the latest technologies and best practices in data engineering and apply them to improve existing systems.
Document data architecture, processes, and workflows.
Provide support and guidance to junior members of the team.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
Bachelor's degree in Computer Science, Engineering, or related field. Master's degree preferred.
3+ yrs of proven experience as a data engineer or similar role, with a strong background in data warehousing, ETL/ELT processes, and data modeling.
Proficiency in programming languages such as Python, Java, or Scala.
Experience with big data technologies such as BigQuery, Spark, Kafka, DBT, SQLMesh etc.
Hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud.
Strong SQL skills and experience working with relational and NoSQL databases.
Familiarity with data visualization tools such as Tableau, Power BI, or Looker.
Excellent problem-solving and analytical skills.
Strong communication and collaboration skills, with the ability to work effectively in a team environment.
Preferred
Experience with containerization and orchestration tools such as Docker and Kubernetes.
Knowledge of machine learning techniques and frameworks.
Experience with DevOps practices and tools for CI/CD.
Benefits
Comprehensive healthcare benefits
Flexible Spending Account (FSA)
Flexible work schedule
Employee Assistance Program (EAP)
Flexible Time Off and Parental Leave
Monthly, quarterly, and annual social and team building events
Monthly internet reimbursement
Company
Harness
Harness is a Continuous Delivery-as-a-Service platform for engineering and DevOps teams to release applications into production.
H1B Sponsorship
Harness has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Trends of Total Sponsorships
2023 (5)
2022 (32)
2021 (12)
2020 (17)
Funding
Current Stage
Late StageTotal Funding
$575MKey Investors
Silicon Valley BankNorwest Venture PartnersAlkeon Capital
2024-05-14Debt Financing· $150M
2022-04-26Debt Financing· $55M
2022-04-12Series D· $175M
Recent News
2024-05-31
Company data provided by crunchbase