82 applicants

Company

Original Job Post

CTG · 2 days ago

Data Engineer

Manassas, VA

Full-time

Onsite

Senior Level

8+ years exp

Wonder how qualified you are to the job?

Maximize your interview chances

ConsultingInformation Technology

Insider Connection @CTG

Discover valuable connections within the company who might provide insights and potential referrals, giving your job application an inside edge.

Responsibilities

Create and maintain optimal data pipeline architecture,

Assemble large, complex data sets that meet functional / non-functional business requirements.

Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

Build data pipeline frameworks to automate high-volume and real-time data delivery to our cloud platform.

Design and develop ETL solutions to move data from any source (relational, API, non-relational) to data warehouse/delta lakes.

Have thorough knowledge of Data warehousing designs and have experience in designing conceptual and logical data models and flowcharts.

Ability to write and maintain Spark and Python notebook in Azure for data integration and analysis.

Apply modern cloud data modeling techniques to ensure development and implementation support efforts meet integration and performance expectations.

Ability to Independently analyze data, solve, and correct issues in real time, providing problem resolution end-to-end.

Coordinate with other IT teams and Client departments to identify future needs and requirements.

Refine and automate regular processes, track issues, and document changes.

Design, develop and maintain data services and/or pipelines as part of an Agile/Scrum team.

Work with program management and engineers to implement and document complex and evolving requirements.

Assist developers with complex query tuning and schema refinement.

Share domain and technical expertise, providing technical mentorship and cross-training to other peers and team members.

Perform multiple tasks simultaneously and successfully perform under changing requirements and deadlines.

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

SQLData warehousingCloud databasesAzureAzure synapseNoSQL databasesCosmosETLAzure data integration toolsAzure data factoryAzure synapse pipelinesSpark notebooksDelta LakeData bricksPerformance TuningOptimizationDevOpsSSRSBusiness ObjectsCognosData visualization toolsPower BITableauUnstructured data managementDevOps tool stackNative monitoringTroubleshooting toolsNew skills/knowledge acquisitionMicrosoft OfficeStandard Operating Procedures

Required

Bachelor's degree or equivalent experience and a minimum of eight (8) years’ experience in designing and developing data integration solutions.

Expertise in SQL and Data warehousing concepts. Experience with modern cloud databases and services in Azure environment. This should include working with Azure synapse environment and also have knowledge of NoSQL databases specially Cosmos.

Experience in designing and implementing ETL in Azure data integration tools (Azure data factory, Azure synapse pipelines, Spark notebooks).

Experience in working on Delta Lake in Azure of data bricks environment and worked in implementing delta lake earlier.

Knowledge to manage huge amounts on unstructured data from devices.

Experience with Performance Tuning and Optimization (PTO), using native monitoring and troubleshooting tools.

Leverage DevOps tool stack to build, inspect, deploy, test and promote new or updated features.

Experience with reporting (e.g. SSRS, Business Objects, Cognos etc.) and data visualization tools (e.g. Power BI, Tableau)

Self-starter, motivated and takes initiative; strong interpersonal and problem-solving skills; able to work collaboratively with all levels of staff to resolve problems to maximize performance, creativity, problem solving and results.

Seek, learn, and apply new skills/knowledge to perform job responsibilities.

Attentive to detail with a high level of accuracy; exercise sound judgment.

Resourceful, diplomatic, and professional; deliver outstanding customer service while managing relationships; a can-do attitude and work style that supports teamwork, collaboration and positive relationships.

Adaptable; be able to shift priorities and focus as departmental and/or business demands change (including, but not limited to early/late hours and/or weekend hours).

Strong analytical skills and organized; completes tasks ahead of schedule.

Excellent written and verbal communication skills, including excellent listening skills to communicate clearly, concisely and effectively.

Position-relevant computer experience including Microsoft Office.

Follow all company safety practices, Standard Operating Procedures (SOP’s) and policies.

Preferred

Experience working with or for Federal Contractors.

Experience in Manufacturing.

Company

CTG

Glassdoor

3.8

CTG serves as a catalyst for your digital transformation, offering innovative solutions and services that accelerate your strategy and project momentum.

Founded in 1966

Buffalo, New York, USA

1,001-5,000 employees