134 applicants

Company

Original Job Post

Attentive · 3 days ago

Senior Big Data Engineer

United States

Full-time

Remote

Senior Level

$150K/yr - $220K/yr

Wonder how qualified you are to the job?

Maximize your interview chances

Marketing AutomationMessaging

H1B Sponsorship

Insider Connection @Attentive

Discover valuable connections within the company who might provide insights and potential referrals, giving your job application an inside edge.

Responsibilities

Participate in design, development, and implementation of robust, high volume data-oriented solutions with big data technologies (Python, Spark, Hadoop, etc.)

Design and implement systems to cleanse, process, and analyze large data sets using distributed processing tools like Flink and Spark

Collaborate with cross-functional teams to understand data requirements and provide effective solutions

Design and build a self-service data platform that powers Attentive’s AI, ML, and analytics needs, enabling them to experiment quickly and build new data products

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

Big Data EngineeringHadoopSparkFlinkKafkaJavaScalaPythonETLData Pipeline OrchestrationApache AirflowDBTObject-Oriented DesignData StructuresAlgorithmsProfilingOptimizationSnowflakeGoogle BigQueryDatabricks LakehouseAWS AthenaApache TrinoPrestoApache IcebergParquetArrowHudiData ModelingData AccessData Replication

Required

Proven experience as a Big Data Engineer with a focus on large-scale data processing.

In-depth knowledge of big data technologies such as Hadoop, Spark, Flink and/or Kafka.

Proficiency in programming languages such as Java, Scala, or Python.

Experience with ETL and Data pipeline orchestration tools like Apache Airflow, DBT, etc.

Strong understanding of object-oriented design, data structures, algorithms, profiling, and optimization.

Development experience with data tools such as Snowflake, Google BigQuery, Databricks Lakehouse, AWS Athena, Apache Trino, or Presto.

Experience with open source data storage formats such as Apache Iceberg, Parquet, Arrow, or Hudi.

Knowledgeable about data modeling, data access, and data replication techniques, such as CDC.

Proven track record of architecting applications at scale and maintaining infrastructure as code via Terraform.

Excited by new technologies but are conscious of choosing them for the right reasons.

Benefits

Health & Wellness

Equity

Company

Attentive

Glassdoor

3.5

Attentive is a personalized mobile messaging platform.

Founded in 2016

New York, New York, USA

1,001-5,000 employees

https://attentive.com

H1B Sponsorship

Attentive has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Trends of Total Sponsorships

2023 (9)

2022 (13)

2021 (11)

2020 (5)