BitMEX · 5 hours ago

Senior Data Engineer

United States

Full-time

Remote

Mid, Senior Level

4+ years exp

Maximize your interview chances

BitcoinCyber Security

Hiring Manager

Christy H.

Insider Connection @BitMEX

Discover valuable connections within the company who might provide insights and potential referrals.
Get 3x more responses when you reach out via email instead of LinkedIn.

Responsibilities

Design and maintain enhancements to our data warehouse, data lake, and data pipelines to increase their reliability and consistency

Improve queriability of large historical datasets through industry-standard tools, careful data representation and aggregation for both technical and business units

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

Data EngineeringData WarehousingData PipelinesAWS RedshiftOLAP DatabasesOLTP DatabasesData StructuringData ModelingAirflow DAGsAWS Glue Data CatalogAWS S3PostgreSQLTerraformKubernetesParquetIcebergTrino

Required

Minimum 4+ years experience in the data engineering field with demonstrated design and technical implementation of data warehouses

Experience with OLAP databases, how they differ from OLTP databases, and data structuring/modeling with understanding of key data points in a business sense for trade-offs between storage/performance and usability

Experience building, deploying, and troubleshooting reliable, idempotent and consistent data pipelines working with disparate in-house and external data-sources, e.g. using Airflow DAGs

Experience with AWS Redshift, Glue Data Catalog, S3, PostgreSQL, Parquet, Iceberg, Trino, and how they are managed using Terraform & Kubernetes