Sr. Data Engineer - Databricks jobs in United States
cer-icon
Apply on Employer Site
company-logo

Shaw Industries · 3 hours ago

Sr. Data Engineer - Databricks

Shaw Industries is seeking a Senior Data Engineer to join their enterprise analytics team. This role involves partnering with data scientists and analysts to support data science projects and building efficient data pipelines.

Home ServicesLogisticsManufacturingShippingTextilesTransportation
check
H1B Sponsor Likelynote

Responsibilities

Partner with data scientists, data analysts, data stewards and product owners to understand data needs and develop solutions
Design, build, launch and maintain efficient and reliable data pipelines to support data analysis and machine learning models
Define and manage standards, guidelines and processes to ensure data quality
Assemble large, complex datasets based on business requirements
Identify and deploy various methods and techniques for optimal extraction, transformation and loading of data from a wide variety of data sources
Help build and maintain best practices for our data engineering strategy – identifying and addressing gaps in existing processes and solutions

Qualification

SQL programmingData pipeline optimizationBig data toolsCloud infrastructureObject-oriented programmingData warehousingData management techniquesAnalytical skillsDevOps practicesAgile environmentCommunication skills

Required

Bachelor's degree in a quantitative field (e.g., Computer Science, Engineering) or a related quantitative field or equivalent work experience is required
At least 4-6 years of work experience in data management disciplines including data integration, modeling, optimization and data quality, and/or other areas directly relevant to data engineering responsibilities and tasks
Expert SQL programming skills
Expertise in at least one relevant object-oriented programming language (e.g., Python, Scala)
Experience building and optimizing data pipelines, architectures and data sets
Experience with big data tools (Spark, Kafka, etc.)
Experience in data warehousing and data modeling
Good knowledge of data management, data integration, and database development techniques with a good understanding of data architecture principles
Strong analytical and problem solving skills
Ability to communicate across all levels of the organization and work with diverse project teams
Experience using cloud-based infrastructure such as Azure and AWS
Experience in DevOps best practices including CI/CD, process automation and optimization

Preferred

Experience with designing and implementing real-time pipelines
Experience with data quality and validation
Experience working in an Agile environment

Company

Shaw Industries

company-logo
Shaw Industries Group, Inc.

H1B Sponsorship

Shaw Industries has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2024 (3)
2022 (1)
2021 (3)
2020 (2)

Funding

Current Stage
Late Stage
Total Funding
unknown
2001-01-08Acquired

Leadership Team

J
Jim Kirkpatrick
Executive Vice President and CFO
linkedin
Company data provided by crunchbase