Be an early applicantLess than 25 applicants

Company

Original Job Post

TRM Labs · 5 days ago

Staff Software Engineer, Data Incrementalization

San Francisco Bay Area

Full-time

Onsite

Senior Level

$240K/yr - $270K/yr

5+ years exp

Wonder how qualified you are to the job?

Maximize your interview chances

Big DataBlockchain

H1B Sponsorship

Comp. & Benefits

Insider Connection @TRM Labs

Discover valuable connections within the company who might provide insights and potential referrals, giving your job application an inside edge.

Responsibilities

Design and build the Cloud Data Warehouse with a focus on incremental updates.

Research innovative methods to optimize data processing and storage.

Develop and maintain ETL pipelines for processing petabytes of data.

Collaborate with teams to design and implement new data models and tools.

Monitor and optimize the Data Platform's performance.

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

PythonSQLData StructuresAlgorithmsData EngineeringBigQuerySnowflakeRedShiftAthenaHivePostgresAirflowDBTLuigiAzkabanStormSparkKafkaFlinkDockerTerraformKubernetesDatadog

Required

Bachelor's degree (or equivalent) in Computer Science or a related field.

5+ years of experience in building distributed system architecture, with a particular focus on incremental updates from inception to production.

Strong programming skills in Python and SQL.

Deep technical expertise in advanced data structures and algorithms for incremental updating of data stores (e.g., Graphs, Trees, Hash Maps).

Comprehensive knowledge across all facets of data engineering, including:

Implementing and managing incremental updates in data stores like BigQuery, Snowflake, RedShift, Athena, Hive, and Postgres.

Orchestrating data pipelines and workflows focused on incremental processing using tools such as Airflow, DBT, Luigi, Azkaban, and Storm.

Developing and optimizing data processing technologies and streaming workflows for incremental updates (e.g., Spark, Kafka, Flink).

Deploying and monitoring scalable, incremental update systems in public cloud environments (e.g., Docker, Terraform, Kubernetes, Datadog).

Expertise in loading, querying, and transforming large datasets with a focus on efficiency and incremental growth.

Benefits

Remote-first work environment

Competitive salaries and stock options

Premium health, dental, and vision insurance

FSA, HSA, and 401K programs

Life & disability coverage

Generous paid time for vacation, holidays, and parental leave

Fertility, professional coaching, and mental health resources

Company

TRM Labs

TRM helps financial institutions, crypto businesses and federal agencies detect and investigate crypto-related financial crimes.

Founded in 2018

San Francisco, California, USA

51-200 employees

https://trmlabs.com

H1B Sponsorship

TRM Labs has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Trends of Total Sponsorships

2023 (2)

2022 (3)

2021 (2)