Acubed · 3 days ago

Senior Data Engineer

Sunnyvale, CA

Full-time

Hybrid

Mid Level

$146K/yr - $171K/yr

3+ years exp

Wonder how qualified you are to the job?

Maximize your interview chances

AerospaceInnovation Management

Hiring Manager

Drew Valencia

Insider Connection @Acubed

Discover valuable connections within the company who might provide insights and potential referrals, giving your job application an inside edge.

Responsibilities

Design, develop, and maintain scalable data and labeling pipelines for computer vision projects

Manage and optimize data storage solutions to ensure efficient data retrieval and processing

Collaborate with machine learning engineers to understand data requirements and ensure the availability of high-quality labeled datasets

Develop and maintain tools and processes for data labeling, including annotation workflows, quality control, and validation procedures

Implement data governance and security protocols to ensure data hygiene

Monitor and troubleshoot data pipeline issues, ensuring timely resolution and minimal disruption to project timelines

Stay up-to-date with the latest trends and technologies in data engineering and computer vision, and apply this knowledge to improve data infrastructure and processes

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

PythonSQLDistributed ComputingData ModelingETL ProcessesData Pipeline DesignData Annotation ToolsCloud Platforms AWSCloud Platforms GCPCloud Platforms AzureWorkflow Management Tools AirflowWorkflow Management Tools DagsterData Movement Tools (Airbyte)OLTP Databases (Postgresql)Problem-SolvingAttention to DetailCommunicationCollaboration

Required

Bachelor’s in Computer Science, Data Engineering, and 3 to 5 years of experience in a related field

Proven experience as a Data Engineer, preferably with a focus on computer vision and data labeling

Strong programming skills in Python, SQL, and experience with distributed computing

Proficiency in data modeling, ETL processes, and data pipeline design

Experience with data annotation tools and frameworks

Familiarity with cloud platforms (AWS, GCP, Azure), workflow management tools (Airflow, Dagster) and tools that simplify data movement (e.g., Airbyte)

Strong understanding of OLTP databases like Postgresql is critical in this role

Excellent problem-solving skills and attention to detail

Strong communication skills and the ability to work effectively in a collaborative team environment