151 applicants

Company

EPAM Systems · 1 day ago

Senior Data Integration Engineer- Telecom

United States

Full-time

Remote

Senior Level

$90K/yr - $150K/yr

Maximize your interview chances

AnalyticsArtificial Intelligence (AI)

Growth Opportunities

H1B Sponsor Likely

Insider Connection @EPAM Systems

Discover valuable connections within the company who might provide insights and potential referrals.
Get 3x more responses when you reach out via email instead of LinkedIn.

Responsibilities

Creating and integrating tables from different data sources on cloud for data acquisition, integration, and analysis

Collecting router logs, storing them in AWS S3, and analyzing them with Athena to generate statistics

Performing transformations & actions on RDDs that can be used as data stage for ETL

Developing automation frameworks by connecting to multiple clusters and databases on the cloud like HBase, Mongo DB, Oracle, Teradata, and SQL Server for achieving simultaneous dataflow

Configuring Glue crawlers, tables, and Athena external tables from the S3 data source to run SQL queries

Querying different data sets with Boto3, Pandas, and Python to connect to AWS S3, HBase, and Athena for querying a large set of data and scheduling multiple jobs on EMR

Using Python, pandas, boto3, and spark to write a reusable code module to handle a large number of datasets

Developing APIs using Lambda and API Gateway to achieve an abstraction layer to integrate with on-prem systems

Building end-to-end test cases to validate the data flow of the APIs. Performing testing on router for the API’s sent from cloud to router and verify E-E functionality. Testing end-to-end API parameters from the routers to the cloud API, and end-to-end testing of TR-69 parameters from the routers

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

AWS servicesBig data pipelineSQLSparkPythonMongoDBHBaseETL toolsAPI developmentTelecommunications IndustryMySQLPostgreSQLTR-69 ProtocolCloud testing toolsScriptingNetworking stackEmbedded systemsData validation techniques

Required

Self-driven with the ability to work independently, get a deep understanding of the domain and context, identify risks and issues, and develop solutions without close supervision.

Hands-on experience with AWS services

Very good understanding of big data pipeline and common database like relational (MySQL & PostgreSQL), MongoDB, HBase

Extensive experience with SQL, including modifying and writing complex queries, particularly using window functions.

Experience performing batch/real time processing using Spark

Experience designing and developing appropriate test automation frameworks and data validation techniques to ensure optimized product performance

Understanding of networking stack and any wireless protocol - preferably 802.11

Experience working with routers & embedded consumer products, preferably knowledge of TR-69 CPE WAN Management Protocol

Experience with Cloud testing tools

Very strong scripting experience using Spark and Python is a must

Preferred

Experience in the Telecommunications Industry is preferred

Benefits

Medical, Dental and Vision Insurance (Subsidized)

Health Savings Account

Flexible Spending Accounts (Healthcare, Dependent Care, Commuter)

Short-Term and Long-Term Disability (Company Provided)

Life and AD&D Insurance (Company Provided)

Employee Assistance Program

Unlimited access to LinkedIn learning solutions

Matched 401(k) Retirement Savings Plan

Paid Time Off – the employee will be eligible to accrue 15-25 paid days, depending on specific level and tenure with EPAM (accrual eligibility may change over time)

Paid Holidays - nine (9) total per year

Legal Plan and Identity Theft Protection

Accident Insurance

Employee Discounts

Pet Insurance

Employee Stock Purchase Program

If otherwise eligible, participation in the discretionary annual bonus program

If otherwise eligible and hired into a qualifying level, participation in the discretionary Long-Term Incentive (LTI) Program

Company

EPAM Systems

Glassdoor

4.1

EPAM leverages its core engineering expertise as a leading global product development and digital platform engineering services company.

Founded in 1993

Newtown, Pennsylvania, USA

10,001+ employees

https://www.epam.com

H1B Sponsorship

EPAM Systems has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2023 (194)

2022 (327)

2021 (343)

2020 (381)