Lead Engineer, Data Pipeline jobs in United States
cer-icon
Apply on Employer Site
company-logo

Worldscape · 3 days ago

Lead Engineer, Data Pipeline

Worldscape Technology, Inc is a cutting-edge platform designed to unify distributed data and intelligent agents across various environments. They are seeking a Lead Data Pipeline Engineer to architect and build scalable distributed data systems, provide technical direction, and collaborate with engineers to drive innovation and performance across their platform.

Computer Software

Responsibilities

Work with product managers and technology teams to understand roadmap priorities and shape product features that address customers' needs
Employ advanced knowledge of data structures, data modeling and design, and common software design patterns focusing on microservice architecture
Articulate design and architecture trade-offs and apply software design patterns to solve complex engineering problems efficiently
Drive design and implementation based on sound engineering principles and best practices, focusing on testability, maintainability, and scalability
Provide overall project design and estimates for business and technology strategy needs during project scoping phases
Manage the velocity of delivery without compromising the quality of product releases
Mentor other engineers to make sound technical decisions and help build effective software engineering practices, especially in adopting formal testing as part of the software development process
Embrace the “you build it, you run it” engineering principle
Champion good software engineering habits, such as clean code principles, security, tech debt balance, TDD, and “going end-to-end early”
Own, diagnose, and resolve complex system technical issues and code defects
Collaborate with engineering leadership to help establish the technical roadmap to facilitate innovation and enhancement of product capabilities
Provide leadership with a point of view on "what’s next" in technology, coding tools, applications, and concepts
Drive a culture of technical excellence, continuous improvement, and lifelong learning

Qualification

C++PythonETL/ELT pipelinesReal-time data processingRelational DatabasesPostgreSQLMySQLCI/CD methodologiesGit-based workflowsCloud infrastructureGraph DatabasesTime-Series DatabasesAgentic AIAutomationSimulationTDD/BDD practicesCommunication skills

Required

Minimum of 8 years of software development experience with a distinguished track record of delivering complex enterprise services (or equivalent experience)
Minimum of 5 years of experience with programming in C++, Python, or an equivalent compiled language
Experience building and maintaining ETL/ELT pipelines
Experience with real-time data processing (Kafka, Apache, and similar)
Experience with multiple database technologies, especially Relational Databases (SQL), PostgreSQL, MySQL, Graph Databases, and Time-Series Databases
Strong understanding of modern CI/CD methodologies and Git-based workflows
Clear and persuasive written and oral communication skills to lead or persuade fellow engineers and non-technical audience
A breadth of technology and engineering skills, knowledge, and experience -comfortable with topics spanning programming languages, agentic AI, advanced networking, compute and data platforms, as well as automation and simulation

Preferred

Experience working on real time data processing technologies
Experience with Edge and IoT processing technologies
Familiarity with testing methodologies and fully comfortable with TDD/BDD development practices
Familiarity with developing applications deployed on public cloud infrastructure such as GCP, AWS, or Azure

Benefits

Competitive salary and meaningful equity
Attractive benefits package
Flexible time off policy
Dental and Vision insurance
FSA or HSA health insurance options
401k plan
Paid parental leave
Fast paced environment with flexibility and ownership
Short Term disability policy/ Long Term disability policy and Life Insurance.

Company

Worldscape

twitter
company-logo
Traditional software constrains the future of global supply chains, sustainability and environmental risk, infrastructure planning, defense, and more.

Funding

Current Stage
Early Stage
Company data provided by crunchbase