MetroStar · 1 day ago

Data Engineer (5493)

United States

Full-time

Remote

Mid, Senior Level

5+ years exp

Maximize your interview chances

Artificial Intelligence (AI)Cloud Data Services

Actively Hiring

No H1B

Security Clearance Required

Insider Connection @MetroStar

Discover valuable connections within the company who might provide insights and potential referrals.
Get 3x more responses when you reach out via email instead of LinkedIn.

Responsibilities

Maintain all operational aspects of data transfers while accounting for the security posture of the underlying infrastructure and the systems and applications that are supported and monitoring the health of the environment through a variety of health tracking capabilities;

Automate configuration management, leverage tools, and stay current on data extract, transfer, and load (ETL) technologies and services;

Work under general guidance, demonstrate an initiative to develop approaches to solutions independently, review architecture, and identify areas for automation, optimization, right-sizing, and cost reduction to support the overall health of the environment;

Apply comprehension of data engineering-specific technologies and services, leverage expertise in databases and a variety of approaches to structuring and retrieving of data, comprehend Cloud architectural constructs, and support the establishment and maintenance of Cloud environments programmatically using vendor consoles;

Engage with multiple functional groups to comprehend client challenges, prototype new ideas and new technologies, help to create solutions to drive the next wave of innovation, and design, implement, schedule, test, and deploy full features and components of solutions

Maintain an existing collection of web scraping tools used as the initial step of the ETL process

Identify and implement scalable and efficient coding solutions

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

Big Data systemsETL processesAmazon Web ServicesApache SparkDatabricksMicrosoft AzureMilCloud 2.0DoD Security STIGsMultiple coding languagesCloud architectural constructsData engineering technologiesData ingestionWeb scraping toolsAutomationDevOps pipelineData analyticsPrototypingSolution design