34 applicants

Company

Original Job Post

adMarketplace · 1 week ago

Senior Data Engineer

New York, NY

Full-time

Onsite

Senior Level

$170K/yr - $220K/yr

5+ years exp

Wonder how qualified you are to the job?

Ad NetworkAdvertising

H1B Sponsorship

Insider Connection @adMarketplace

Discover valuable connections within the company who might provide insights and potential referrals, giving your job application an inside edge.

Responsibilities

Develop and maintain ad-tech related data systems and system components using Python including data streaming, processing, and aggregation solutions

Work with the team for technical implementation of Data Engineering projects including data streaming, data transformation and aggregation pipelines

Build data pipelines on cloud-based platforms

Work closely with QA, DevOps, and other engineering teams to integrate, test and release different system components (all stages of SDLC)

Work closely with business stakeholders and other engineers on understanding and translating business requirements into technical solutions

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

PythonBig DataApache SparkApache KafkaData WarehouseCloud AnalyticsDatabricksSnowflakeETL ProcessingWorkflow ManagementAirflowArgo WorkflowsAzkabanSQLNoSQLAWSGCPAzureLinuxShell ScriptingContinuous IntegrationContinuous DeliveryAutomationProblem-SolvingCollaborationCommunicationTroubleshootingJava/Scala DevelopmentSearch Engines Apache SolrSearch Engines ElasticSearch

Required

BS in Engineering, Computer Science or related discipline

5+ years strong hands-on development experience using Python

Experience with big data and streaming technologies like Apache Spark, Apache Kafka and Data Warehouse

Experience with Cloud Analytics platforms like Databricks/Snowflake

Experience developing, delivering and maintaining scalable data streaming, ETL processing and aggregation pipelines

Experience Workflow Management tools like Airflow, Argo Workflows, Azkaban

Experience with relational SQL and NoSQL databases

Experience with public cloud AWS/ GCP/ Azure

Experience working in a Linux environment/ Shell Scripting

Ability to collaborate with multiple teams and understanding testing and deployment methodologies

Experience building software in continuous integration and delivery fashion in an automated way

Excellent documentation, communication, and troubleshooting skills

Preferred

Experience with Java/Scala development

Databricks experience is a big plus

Experience with Search Engines like Apache Solr, ElasticSearch

Agile software development experience

Prior experience in the ad tech or e-commerce industry

Benefits

Comprehensive healthcare

Wellness programs

Paid time off

Commuter benefits

401k matching

Dog friendly office

Summer Fridays

Catered lunches

Fully stocked kitchen

ZogSports teams

Happy hours

Corporate retreats

Company

adMarketplace

Glassdoor

2.4

adMarketplace is a search advertising marketplace that provides custom monetization solutions for digital publishers.

Founded in 2000

New York, New York, USA

201-500 employees

http://www.admarketplace.com

H1B Sponsorship

adMarketplace has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Trends of Total Sponsorships

2023 (19)

2022 (21)

2021 (14)

2020 (10)