200+ applicantsPosted by Agency

Company

Kforce Inc · 4 hours ago

Data Engineer

Madison, WI

Contract

Remote

Mid Level

3+ years exp

Maximize your interview chances

ConsultingEmployment

H1B Sponsor Likely

Insider Connection @Kforce Inc

Discover valuable connections within the company who might provide insights and potential referrals.
Get 3x more responses when you reach out via email instead of LinkedIn.

Responsibilities

Create and optimize ETL (Extract, Transform, Load) processes using AWS services such as Glue, S3, Lambda and Data Pipelines

Develop scalable data architectures that support our microservice-based data ecosystem

Utilize Terraform for infrastructure as code (IaC) to set up and manage resources

Implement best practices in data modeling, ensuring efficient data structures

Use PySpark and Python scripting for data transformation and enrichment

Work with Glue crawlers to discover and catalog data sources

Build and maintain Lambda functions for serverless data processing

Leverage Glue jobs for data transformation and orchestration

Utilize Glue catalog for metadata management

Implement logging, monitoring, and alerting using AWS CloudWatch and other relevant tools

Work with Delta Lake and Databricks for advanced analytics and data processing

Query data stored in S3 data lakes using AWS Athena

Interface with business stakeholders to gather requirements and deliver complete reporting solutions

Collaborate with cross-functional teams to ensure data consistency and accuracy

Stay updated with industry trends and emerging technologies related to data engineering

Identify opportunities for process optimization and automation

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

AWS technologiesData engineeringPythonPySparkTerraformGlue jobsLambda functionsGlue crawlersDelta LakeDatabricksS3 data lake storageTeamwork abilities

Required

Bachelor's degree in Computer Science, Information Systems, or a related field

3+ years of experience in data engineering, preferably with a focus on AWS technologies

Proficiency in Python and PySpark

Familiarity with Terraform for infrastructure provisioning

Experience with Glue jobs, Lambda functions, and Glue crawlers

Knowledge of Delta Lake, Databricks, and S3 data lake storage

Strong problem-solving skills and attention to detail

Excellent communication and teamwork abilities

Benefits

Medical/dental/vision insurance

HSA

FSA

401(k)

Life, disability & ADD insurance

Paid time off

Paid sick leave

Company

Kforce Inc

Glassdoor

3.8

Kforce is a solutions firm specializing in technology and other professional staffing services.

Founded in 1962

Tampa, Florida, USA

1001-5000 employees

https://www.kforce.com/

H1B Sponsorship

Kforce Inc has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2023 (604)

2022 (772)

2021 (1207)

2020 (914)