HireTalent - Diversity Staffing & Recruiting Firm ยท 3 hours ago
Data Engineer 4 #: 24-08236
Beaverton, OR
Contract
Remote
Senior Level
7+ years exp
Maximize your interview chancesDeliveryHuman Resources
Insider Connection @HireTalent - Diversity Staffing & Recruiting Firm
Get 3x more responses when you reach out via email instead of LinkedIn.
Responsibilities
Design, build, and maintain large-scale data pipelines using AWS EMR, Spark, and Python
Develop and optimize Spark applications and ETL pipelines for performance and scalability
Collaborate with product managers and analysts to design and implement data models and data warehousing solutions
Work with cross-functional teams to integrate data systems with other applications and services
Ensure data quality, integrity, and security across all data systems
Develop and maintain unit test cases for data pipelines and applications
Implement CI/CD pipelines for automated testing and deployment
Collaborate with the DevOps team to ensure seamless deployment of data applications
Stay up to date with industry trends and emerging technologies in big data and cloud computing
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
7-8 years of experience in data engineering, big data, or a related field
Proficiency in Spark, including Spark Core, Spark SQL, and Spark Streaming
Experience with AWS EMR, including cluster management and job optimization
Strong skills in Python, including data structures, algorithms, and software design patterns
Hands-on experience with Databricks
Experience with optimizing Spark applications and ETL pipelines for performance and scalability
Good understanding of data modeling, data warehousing, and data governance
Strong understanding of software development principles, including unit testing and test-driven development
Ability to design and implement scalable data solutions that meet business requirements
Strong problem-solving skills, with the ability to debug complex data issues
Excellent communication and collaboration skills, with the ability to work with cross-functional teams
Preferred
Hands-on experience with Databricks Lakehouse
Experience with CI/CD tools such as Jenkins, GitLab, or CircleCI
Knowledge of data engineering best practices and design patterns
Experience with agile development methodologies, such as Scrum or Kanban
Company
HireTalent - Diversity Staffing & Recruiting Firm
HireTalent is a certified Minority Business Enterprise (MBE) workforce solutions firm, specializing in securing the best talent fits in Executive/Retained Search, Direct Hire Placements, MSP, SOW, and nationwide hiring program management and support.
501-1000 employees
Funding
Current Stage
Late StageLeadership Team
Ashish Kaushal
Founder and CEO
Company data provided by crunchbase
