Lumen Technologies · 13 hours ago

Big Data Developer

United States

Full-time

Remote

Senior Level, Lead/Staff

$111K/yr - $172K/yr

Maximize your interview chances

Big DataInformation Services

Actively Hiring

Insider Connection @Lumen Technologies

Discover valuable connections within the company who might provide insights and potential referrals.
Get 3x more responses when you reach out via email instead of LinkedIn.

Responsibilities

Provide technical direction in the creation, implementation, and integration of complex big data solutions

Collaborate and translate business requirements into implementation design and participate in the design, evaluation, and selection of best software solutions to achieve business objectives

Design, develop, test, and deploy scalable and reliable data pipelines using technologies like Spark, Kafka, Hadoop, and other big data technologies

Extract, transform, and load data from various sources and formats, such as relational databases, APIs, JSON, XML, CSV, etc.

Perform data quality checks and validations, and handle data anomalies and issues

Collaborate with other developers, data engineers, data analysts, and business stakeholders to understand data requirements and deliver data solutions

Develop scalable systems that enable real-time validation of identified resources

Mentor junior developers and engineers on the team and champion industry best practices

Explore, evaluate and conduct PoC to determine new technology solutions that would improve our ability to detect newer threats or add efficiency to current processes

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

Big Data technologiesSparkKafkaHadoopHivePythonJavaScalaSQLTeamwork skillsMentoring skills