Jobs via Dice · 2 days ago
Senior Data Engineer - San Francisco, CA – 3 days a week in office is a must
Dice is the leading career destination for tech experts at every stage of their careers. Our client, Prohires, is seeking a Senior Data Engineer to develop and maintain systems, ensuring high quality and innovative solutions. The role involves supporting code deployments for data pipelines and ensuring data quality in specific areas.
Computer Software
Responsibilities
System development and maintenance activities of the team to meet service level agreements and create solutions with innovation, cost effectiveness, high quality and faster time to market
Support code versioning, and code deployments for Data Pipelines
Ensure test coverage for unit testing and support integration and performance testing
Contribute ideas to help ensure that required standards and processes are in place
Research and evaluate current and upcoming technologies and frameworks
Build data expertise and own data quality for your areas
Qualification
Required
2-5+ years of Scala, Java development experience
2+ years of SQL and NoSQL experience (handling structured and unstructured data)
1+ years of extensive experience with Spark Processing engine
1+ years of experience with Big data tools / technologies/ Streaming (Hive, Impala, OOZIE, Airflow, NIFI, Kafka)
1+ years experience with Data Modeling
Experience analyzing data to discover opportunities and address gaps
Experience working with cloud or on-prem Big Data platform(i.e. Netezza, Teradata, AWS Redshift, Google BigQuery, Azure Data Warehouse, or similar)
Must Have: Scala, Java + Spark ( can strong Java with some Scala + Spark)
The candidate must work from the office 3 days per week
Preferred
Proficient In Scala, Java, Or Python( Least Preferred)
Company
Jobs via Dice
Welcome to Jobs via Dice, the go-to destination for discovering the tech jobs you want.
Funding
Current Stage
Early StageCompany data provided by crunchbase