Software Engineer - Big Data Backend jobs in United States
cer-icon
Apply on Employer Site
company-logo

LiveRamp · 2 weeks ago

Software Engineer - Big Data Backend

LiveRamp is a data collaboration platform that prioritizes consumer privacy and data ethics. The Software Engineer - Big Data Backend will collaborate with a team to develop and enhance high-performance data ingest and processing systems, utilizing technologies such as Java and Spark.

AdvertisingAdvertising PlatformsAnalyticsBrand MarketingData Integration
check
Comp. & Benefits
check
H1B Sponsor Likelynote

Responsibilities

Collaborate with a team of supportive and passionate software engineers, product, infrastructure and other internal partners to tackle challenging problems, execute on development projects that build, enhance and customize our high-performance data ingest, partitioning, graph and edge building systems
Foster a positive environment of integrity, operational excellence to achieve a high level of technical productivity, reliability, and simplicity by developing in Java and leveraging tools/frameworks like Docker, Kubernetes, Terraform, Java, Gradle, Jenkins, GCP, Hadoop and Spark, SQL and err on the side of shipping fast and iterating
Find feedback to be important in helping us grow as individuals and as a team; we’re always looking for chances to kindly share positive and constructive feedback and we aim to accept feedback with grace
Follow a Scrum-based devops model with a few guiding principles: Support, trust and motivate the people involved, Continuous software delivery and process improvement, Minimize barriers to development and leverage automation
Work on: Edge Ingestion and Partitioning Framework: We could never process all trillion edges at once and luckily we don’t have to. Instead we process subgraphs that contain specific types of edges
Path Computation as a Service: We provide a service to other LiveRamp engineering teams for finding specific types of paths within our massive graph. It services 80,000 requests, 10PB data per day and this is possible due to its use of highly scalable Spark jobs/ SingleStore DB procedures and intelligent caching mechanism
Project categories: besides product requests and enhancements, we work on projects in performance and cost optimization, security and legal compliance, reliability and quality initiatives, as well as architectural refreshes such as POC in restructuring our data to be more streaming/real time friendly, new REST API for relevant services, migration of apps to Spark, Parquet, and other new technologies that could make our processing faster, more scalable, maintainable and cost effective

Qualification

JavaSparkHadoopGCPSQLDockerKubernetesTerraformRESTful APIsDistributed systemsBatch processingTeam collaboration

Required

2+ years of experience writing and deploying object oriented production code
2+ years of experience writing and optimizing large-scale batch processing pipelines in Java, Spark/Hadoop and/or SQL
2+ years of experience using cloud based platforms such as GCP, AWS, Azure or similar technologies
Have a passion for building large-scale distributed systems and are comfortable writing maintainable and high performance code
Comfortable learning and adapting to the latest tools and technologies
You love helping a team build and deploy software that conforms to best practices
Startup personality and enjoy working as part of a team: smart, ethical, friendly, hard-working, and productive

Preferred

Experience with GCP products such as BigTable, BigQuery, Dataproc, PubSub or other data tools like Kafka, Hive, or Apache Beam
Experience with development tools such as Terraform, Kubernetes, Helm, or Gradle
Experience with designing and implementing interfaces and infrastructure for large scale systems and/or RESTful APIs

Benefits

People: work with talented, collaborative, and friendly people who love what they do.
In-Office Food: enjoy catered meals, boundless snacks.
Fun: we host in-person and virtual events such as game nights, happy hours,
Work/Life Harmony: flexible paid time off, options for working from home, and paid parental leave.
Whole Health Package: Medical, dental, vision, life, disability, long term care, accident and critical illness insurance, pre-tax accounts (health, dependent and commuter), and a family forming benefit through Carrot. Plus Milk Stork, backup child and elder care, and discount on pet insurance, mental health support (via Talkspace)
FlexPerks reimbursement program to provide flexibility and choice ($375/quarter) for fitness, emotional, financial, family, travel and entertainment, convenience and security expenses. (U.S. LiveRampers)
Learning perks : Learning and tuition reimbursements
Savings: Our 401K matching plan—1:1 match up to 6% of salary—helps you plan ahead. Also Employee Stock Purchase Plan - 15% discount off purchase price of LiveRamp stock (U.S. LiveRampers)
RampRemote: a comprehensive program to assist you in setting up a home office that works for you
Location: Work from SF office and from home (Hybrid)
Comprehensive Benefits Package: LiveRamp offers a comprehensive benefits package designed to help you be your best self in your personal and professional lives. Our benefits package offers medical, dental, vision, life and disability, an employee assistance program, voluntary benefits as well as perks programs for your healthy lifestyle, career growth and more.
RampRemote: A comprehensive office equipment and ergonomics program—we provide you with equipment and tools to be your most productive self, no matter where you're located

Company

LiveRamp

company-logo
LiveRamp aspires to make it safe and easy for companies to use data effectively.

H1B Sponsorship

LiveRamp has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (48)
2024 (51)
2023 (17)
2022 (53)
2021 (39)
2020 (17)

Funding

Current Stage
Public Company
Total Funding
$16M
2018-10-29IPO
2013-04-01Series C
2011-09-06Series Unknown· $1M

Leadership Team

leader-logo
Scott Howe
Chief Executive Officer
linkedin
leader-logo
Burak Emre Kabakçı
Sr. Staff Software Engineer
linkedin
Company data provided by crunchbase