Senior Data Engineer (Data) jobs in United States
cer-icon
Apply on Employer Site
company-logo

Stable Kernel · 4 hours ago

Senior Data Engineer (Data)

Stable Kernel is a technology services firm and custom software developer building scalable software solutions for cutting-edge, innovative enterprises. As a Senior Data Engineer, you will develop and deliver innovative data initiatives, collaborating with teams to design and optimize data pipelines that provide actionable insights for clients.

Artificial Intelligence (AI)Consumer SoftwareData IntegrationData VisualizationEnterprise SoftwareMachine LearningMobile AppsMobile PaymentsSoftware EngineeringUsability Testing
check
Comp. & Benefits
badNo H1Bnote

Responsibilities

Design and implement robust data pipelines, with an eye to the growth of the product and team, improving the speed of future work and ensuring high data quality and contributing to DataOps/DevOps initiatives to ensure complete and timely data flows
Improve performance of data pipelines and data lake queries used by data analysts
Apply your firm grasp of the concepts and practices of data engineering in the areas of ingestion, transformation, serving with a strong awareness of system and project needs for security, data management, DataOps, Data architecture, orchestration and standard software engineering practices
Providing expert feedback that improves the overall delivery of work
Defending the work against compromise and corner-cutting
Designing test strategies and involving yourself in CI/CD and automated testing for high system reliability
Mentoring others in best practices
Ensuring a high standard of quality across the project
Identifying, diagnosing, and resolving complex pipeline and data issues
Understanding the client's business and goals and using them to create and update roadmap issues
Identifying opportunities to provide additional value for our clients by suggesting and delivering improvements based on your observations
Contributing to the estimation of work for high-level planning and costing that clearly identifies gaps, risks, and assumptions
Coordinating with data stakeholders outside your team as necessary
Influencing your team's roadmap
Advising people across the Director and VP-levels of the organization
Reporting status with a general understanding of where each member's work is
Designing and supporting long-term roadmaps with limited direction and requiring no direction on project plans
Considering and planning around cross-department dependencies to most effectively break down work across the team and solicit data product use cases and requirements
Working with ambiguity to define and break down challenging projects (e.g., projects that are hard to derive benefits from until the end of the project, projects that are very large, or projects that have a lot of uncertainty or require novel solutions)
Making trade-offs between short-term and long-term solutions
Evaluating trade-offs others are making
Analyzing the effectiveness of decisions and demonstrating accountability for outcomes
Anticipating, recognizing, and mitigating risks to prevent potential roadblocks
Escalating issues and bringing recommended solutions to the table
Setting a positive example by using our company values and imperatives as a north star
Providing regular constructive feedback
Resolving conflicts
Guiding less experienced colleagues through complex projects
Leading team learning sessions
Demonstrating strong project roadmapping skills, including planning, delegating, and monitoring progress
Making critical decisions and driving projects to successful completion
Representing the team in client conversations
Taking ownership and contributing to process improvements that positively impact the work
Advocating for best practices across your project or client program
Mentoring junior and intermediate colleagues by helping them grow professionally
Leading projects

Qualification

PythonAWS servicesETL/ELT pipelinesData Quality ManagementCI/CDData IntegrationMentoringProblem-SolvingLeadership

Required

7-10 years of development experience
Degree in Computer Science or relevant field or experience
Extensive experience using Python
Designing and building data pipelines
Developing and maintaining scalable ETL/ELT pipelines using AWS services such as AWS Glue, Lambda, and Step Functions to extract, transform, and serve data from upstream sources
Custom extraction from non-SQL sources (e.g., APIs) using established industry patterns for incremental and full snapshot datasets using Python and standard data engineering/data science libs
Implementing and enforcing data quality checks to ensure the accuracy, consistency, and reliability of data across systems
Create and manage CI/CD to deploy system and data changes

Preferred

Proven experience using additional programming languages is a plus
Experience creating cloud resources using Infrastructure as Code technologies such as Terraform or Pulumi

Benefits

Company-subsidized health, vision, and dental plan premium options beginning on the first day of employment
401k with above-average company matching
Fully paid Group Life, Short and Long Term Disability, and AD&D insurance
Optional Flexible Spending Account and Health Savings Account participation
Voluntary Life, Critical Illness, and Accident insurance
EAP and Health Advocacy program available at no cost to employees and their dependents
$3000+ annual industry educational budget
Paid time off and paid holidays Access to Perks at Work program featuring a variety of discounted products and services

Company

Stable Kernel

twittertwittertwitter
company-logo
Stable Kernel specializes in custom software, data architecture, and AI solutions for foodservice enterprises

Funding

Current Stage
Growth Stage

Leadership Team

leader-logo
Jason Russell
CEO/Co-Founder
linkedin
leader-logo
Jami Sieder
Chief People & Culture Officer
linkedin
Company data provided by crunchbase