HireTalent - Staffing & Recruiting Firm · 2 months ago
Data Engineer 4
Salem, OR
Full-time
Onsite
Senior Level, Lead/Staff
10+ years expHireTalent is a staffing and recruiting firm seeking a Data Engineer 4 to contribute to the design and implementation of data products and features. The role involves working with product owners and data analysts to process and store large data volumes, as well as implementing distributed data processing pipelines and ensuring quality solutions are delivered.
DeliveryHuman ResourcesStaffing Agency
Responsibilities
Contribute to Design and implement data products and features in collaboration with product owners, data analysts, and business partners using Agile / Scrum methodology
Contribute to overall architecture, frameworks and patterns for processing and storing large data volumes
Contribute to evaluation of new technologies/tools/frameworks centered around high-volume data processing
Translate product backlog items into logical units of work in engineering
Implement distributed data processing pipelines using tools and languages prevalent in the big data ecosystem
Build utilities, user defined functions, libraries, and frameworks to better enable data flow patterns
Work with engineering leads and other teams to ensure quality solutions are implemented, and engineering best practices are defined and followed
Build and incorporate automated unit tests and participate in integration testing efforts
Utilize and advance continuous integration and deployment frameworks
Troubleshoot data issues and perform root cause analysis
Work across teams to resolve operational & performance issues
Qualification
Required
Bachelor's degree in Computer Science, or related technical discipline
10+ years of experience in large-scale software development, 5+ years of big data experience
Programming experience, Python or Scala preferred
Experience working with Hadoop and related processing frameworks such as Spark, Hive, etc
Experience with messaging/streaming/complex event processing tooling and frameworks
Experience with data warehousing concepts, SQL and SQL Analytical functions
Experience with workflow orchestration tools like Apache Airflow
Experience with source code control tools like Github or Bitbucket
Ability to communicate effectively, both verbally and written, with team members
Interest in and ability to quickly pick up new languages, technologies, and frameworks
Experience in Agile/Scrum application development
Preferred
Experience with Java
Experience working in a public cloud environment, particularly AWS, databricks
Experience with cloud warehouse tools like Snowflake
Experience working with NoSQL data stores such as HBase, DynamoDB, etc
Experience building RESTful API's to enable data consumption
Experience with build tools such as Terraform or CloudFormation and automation tools such as Jenkins or Circle CI
Experience with practices like Continuous Development, Continuous Integration and Automated Testing
Company
HireTalent - Staffing & Recruiting Firm
HireTalent is a certified Minority Business Enterprise (MBE) workforce solutions firm, specializing in securing the best talent fits in Executive/Retained Search, Direct Hire Placements, MSP, SOW, and nationwide hiring program management and support.
1001-5000 employees
Funding
Current Stage
Late StageLeadership Team
Ashish Kaushal
CEO / Founder
Company data provided by crunchbase