Epsilon · 7 hours ago
Senior Software Engineer (Big Data)
Epsilon is a global data, technology and services company that powers the marketing and advertising ecosystem. They are seeking a Senior Software Engineer (Big Data) to design, develop, and maintain scalable data processing solutions, optimizing performance in large-scale big data environments while collaborating with cross-functional teams.
AdvertisingDigital MediaEmailMarketingMobileSocial Media
Responsibilities
Design, develop, and maintain scalable data processing solutions across on-premises and cloud environments using Python and Apache Spark
Optimize and fine-tune Spark jobs for performance, including resource utilization, shuffling, partitioning, and caching, to ensure maximum efficiency in large-scale big data environments
Design and implement scalable, fault-tolerant data pipelines with end-to-end monitoring, alerting, and logging
Leverage AWS cloud services (2+ years preferred) to build and manage data pipelines and distributed processing workloads
Develop and optimize SQL queries across relational and data warehouse systems (RDBMS/Data Warehouse)
Apply design patterns and best practices for efficient data modeling, partitioning, and distributed system performance
Use Git (or equivalent) for source control and maintain strong unit and integration testing practices
Collaborate with Product Owners, partners, and multi-functional teams to translate business requirements into technical solutions
Demonstrate strong analytical skills with the ability to extract actionable insights from large datasets and support data-driven decision-making
Mentor junior engineers, conduct code reviews, and contribute to establishing engineering best practices and standards
Qualification
Required
5+ years of software development experience in a scalable, distributed, or multi-node environment
Proficient in programming with Scala, Python, or Java; comfortable building data-driven solutions at scale
Significant experience with Apache Spark and exposure to Hadoop, Hive, and related big data technologies
Demonstrated experience with cloud platforms (AWS) and an interest in cloud migration projects
Eager to deepen your expertise with the Databricks platform
Exposure to modern data tools and frameworks such as Kubernetes, Docker, and Airflow
Strong problem-solving skills with the ability to own problems end-to-end and deliver results
Consultative mentality — comfortable taking initiative, building relationships, communicating broadly, and tackling challenges head-on
Collaborative teammate with an eagerness to learn from peers and mentors while contributing to a culture of growth
Motivated to grow your career within a dynamic, innovative company
BA/BS in Computer Science or related field
At least 5 years of experience as a big data software developer
Experience in Machine Learning, including model development, feature engineering, or integrating ML workflows into data pipelines
Preferred
2+ years of experience with AWS cloud services
Experience with Databricks, including Notebooks, Delta Lake, Jobs, Pipelines, and Unity Catalog
Proficiency with the ELK stack (Elasticsearch, Logstash, Kibana) for real-time search, log analysis, and visualization
AWS, Databricks, or Spark certification
Benefits
Flexible time off (FTO)
15 paid holidays
Paid sick time
Parental/new child leave
Childcare & elder care assistance
Adoption assistance
Comprehensive health coverage
401(k)
Tuition assistance
Commuter benefits
Professional development
Employee recognition
Charitable donation matching
Health coaching and counseling
Company
Epsilon
Epsilon is an all-encompassing global marketing company, a leader in creating connections between people and brands.
H1B Sponsorship
Epsilon has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (132)
2024 (128)
2023 (124)
2022 (201)
2021 (136)
2020 (137)
Funding
Current Stage
Late StageTotal Funding
unknown2019-04-15Acquired
Recent News
Washington Technology
2025-12-19
Washington Technology
2025-12-09
2025-12-03
Company data provided by crunchbase