TRM Labs · 17 hours ago
Staff Software Engineer, Data Incrementalization
United States
Full-time
Remote
Senior Level
5+ years exp
Maximize your interview chancesBig DataBlockchain
Insider Connection @TRM Labs
Get 3x more responses when you reach out via email instead of LinkedIn.
Responsibilities
Design and build our Cloud Data Warehouse with a focus on incremental updates to improve cost efficiency and scalability.
Research innovative methods to incrementally optimize data processing, storage, and retrieval to support efficient data analytics and insights.
Develop and maintain ETL pipelines that transform and incrementally process petabytes of structured and unstructured data to enable data-driven decision-making.
Collaborate with cross-functional teams to design and implement new data models and tools focused on accelerating innovation through incremental updates.
Continuously monitor and optimize the Data Platform's performance, focusing on enhancing cost efficiency, scalability, and reliability.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
Bachelor's degree (or equivalent) in Computer Science or a related field.
5+ years of experience in building distributed system architecture, with a particular focus on incremental updates from inception to production.
Strong programming skills in Python and SQL.
Deep technical expertise in advanced data structures and algorithms for incremental updating of data stores (e.g., Graphs, Trees, Hash Maps).
Comprehensive knowledge across all facets of data engineering, including: Implementing and managing incremental updates in data stores like BigQuery, Snowflake, RedShift, Athena, Hive, and Postgres.
Orchestrating data pipelines and workflows focused on incremental processing using tools such as Airflow, DBT, Luigi, Azkaban, and Storm.
Developing and optimizing data processing technologies and streaming workflows for incremental updates (e.g., Spark, Kafka, Flink).
Deploying and monitoring scalable, incremental update systems in public cloud environments (e.g., Docker, Terraform, Kubernetes, Datadog).
Expertise in loading, querying, and transforming large datasets with a focus on efficiency and incremental growth.
Company
TRM Labs
TRM helps financial institutions, crypto businesses and federal agencies detect and investigate crypto-related financial crimes.
201-500 employees
H1B Sponsorship
TRM Labs has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (2)
2022 (3)
2021 (2)
Funding
Current Stage
Growth StageTotal Funding
$149.9MKey Investors
Thoma BravoJP Morgan ChaseTiger Global Management
2022-11-09Series B· $70M
2022-04-04Series B· undefined
2022-02-28Series Unknown· undefined
Leadership Team
Esteban Castaño
Co-Founder & CEO
Rahul Raina
Co-Founder & CTO
Recent News
2024-11-20
Company data provided by crunchbase
