56 applicants

Company

Original Job Post

Leidos · 2 days ago

Lead Data Engineer

Full-time

Onsite

Senior Level

$101K/yr - $183K/yr

8+ years exp

Wonder how qualified you are to the job?

Maximize your interview chances

ComputerGovernment

Actively Hiring

Insider Connection @Leidos

Discover valuable connections within the company who might provide insights and potential referrals, giving your job application an inside edge.

Responsibilities

Serve as subject matter expert in providing highly performant and reusable data solutions.

Ensure data architecture adheres to compliance standards employing strong security measures.

Develop methods to improve data quality, cleaning, and anomaly detection.

Leverage Data Analytics capabilities including PySpark, AWS Glue, and AWS DMS, to create data pipelines for complex datasets.

Administer PostgreSQL databases and data replication, including configuration, monitoring, and schema management.

Use SQL expertise to develop highly performant queries and DML in PySpark, including providing guidance and leadership to the development team.

Orchestrate job workflows using AWS Services including Step Functions, Lambda, EventBridge, SNS, and SQS.

Develop Python and bash shell scripts to automate database tasks, file handling, and system administration.

Automate deployments and Infrastructure as Code using CloudFormation and other AWS CI/CD services.

Design, develop, and implement cloud-based solutions, tools, and services using AWS technologies.

Use knowledge of Linux and AWS to manage infrastructure and batch operations effectively.

Conduct data mining and aggregation to identify data patterns.

Conduct data analysis using statistical models and forecasting techniques.

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

Data AnalyticsPySparkAWS GlueAWS DMSData PipelinesPostgreSQLSQLAWS ServicesStep FunctionsLambdaEventBridgeSNSSQSPythonBash Shell ScriptingAWS CloudFormationCI/CDInfrastructure as CodeAWSLinuxInfrastructure ManagementCloud SolutionsData MigrationCOBOLData Quality MonitoringAnomaly DetectionData MiningData AggregationStatistical AnalysisForecasting

Required

Bachelor's degree in statistics, computer science, or related field with 8+ years of prior relevant background or Master’s degree with 6+ years of prior relevant background.

Strong expertise in Data Analytics including PySpark, AWS Glue, AWS DMS, and data pipelines.

Expertise in administering PostgreSQL databases and data replication, including configuration, monitoring, and schema management, along with high proficiency in SQL.

Expertise in automating and orchestrating job workflows using AWS Services including Step Functions, Lambda, EventBridge, SNS, and SQS.

Strong expertise using Python and bash shell scripting to automate database tasks, file handling, and system administration.

Expertise with writing AWS CloudFormation and using other AWS CI/CD services to automate deployments and Infrastructure as Code.

Extensive working background with AWS, showcasing proficiency in designing, developing, and implementing cloud-based solutions, tools, and services.

Thorough comprehension of Linux environments and operations, in particular for managing infrastructure and batch operations effectively.

Familiarity with a range of technical tools and platforms demonstrating adaptability and versatility in working with different technologies.