Apply on Employer Site

Leidos · 4 months ago

ETL Developer

Bethesda, MD

Full-time

Onsite

Mid Level

$85K/yr - $154K/yr

4+ years exp

Leidos has a new and exciting opportunity for an ETL Developer in their National Security Sector's Cyber & Analytics Business Area. The role involves designing, developing, and implementing data flow solutions using Apache NiFi, while ensuring optimal performance and integration with various data ecosystems.

ComputerGovernmentInformation ServicesInformation TechnologyNational SecuritySoftware

No H1B

Security Clearance Required

Responsibilities

Building complex NiFi data pipeline design: Develop and implement enterprise-level ETL NiFi data pipelines for large-scale data ingestion, transformation, and processing from diverse sources

Performance optimization and tuning: Optimize NiFi data flows, including processor tuning, memory management, and load balancing, ensuring optimal performance for batch and real-time processing

Troubleshooting and problem resolution: Identify, diagnose, and resolve complex NiFi data flow issues, including performance bottlenecks, data discrepancies, and integration failures

Integrating with big data and cloud technologies: Seamlessly integrate NiFi with various databases, big data ecosystems, and cloud platforms (e.g., AWS, OCI, Azure), demonstrating familiarity in relevant services (e.g., Kafka, Elasticsearch, S3, SQS/SNS)

Follow best practices and standards: Follow establish best practices for NiFi development, deployment, security, and governance, ensuring adherence to enterprise-wide data management policies

Documentation and knowledge sharing: Create and maintain comprehensive documentation for NiFi data flows, mappings, architectures, and standard operating procedures, ensuring knowledge transfer and promoting efficient team operations

Collaboration and communication: Collaborate effectively with data architects, data engineers, application/service developers, and other stakeholders to translate business requirements into robust technical solutions

Qualification

Apache NiFiETL developmentCloud platformsJavaPythonNoSQL databasesReal-time streamingCollaborationProblem-solvingDocumentation

Required

Direct experience designing, developing, and managing complex NiFi data flow solutions in large-scale enterprise environments

Experience in programming languages like Java and/or Python and scripting for automation

Experience writing and optimizing complex queries, along with experience in interacting with relational and NoSQL databases (e.g., Postgres, Elasticsearch, DynamoDB)

Experience with real-time streaming, and API integration (REST) for seamless data connectivity

Experience with cloud platforms like AWS, Azure, or OCI and related data services

Ability to analyze complex data challenges, identify root causes, and implement effective solutions

Ability to collaborate effectively with cross-functional teams and articulate technical concepts clearly

Bachelor's degree with 4 or more years of prior relevant experience or Master's degree with 2 or more years of relevant experience. Will consider experience in lieu of a degree

To be considered must have an active TS/SCI with polygraph security clearance

Preferred

Experience deploying ETL solutions in an AWS environment

Experience developing custom NiFi processors with Java and/or Python

Direct knowledge of NiFi architecture, processors, and configurations, along with hands-on experience with NiFi Registry and clustering for high availability and scalability