Data Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

William & Mary Libraries · 11 hours ago

Data Engineer

William & Mary Libraries is seeking a Data Engineer to help build and maintain data pipelines that power their analytics ecosystem. The role involves collaborating with data architects and analysts to ensure data is accurate and accessible for reporting and advanced analytics, while also supporting data quality and governance practices.

Higher Education
check
H1B Sponsor Likelynote

Responsibilities

Collaborate with data architects, data scientists, and analysts to understand requirements and translate them into implementable data pipelines and curated datasets
Build and maintain data ingestion and transformation workflows using approved tools and standards
Integrate data from enterprise systems and external sources using APIs, files, and batch ingestion patterns
Develop and maintain curated datasets that support reporting, dashboards, and advanced analytics
Create and maintain clear documentation for pipelines, datasets, refresh schedules, data definitions, and known limitations
Implement basic data quality checks and reconciliation processes to improve accuracy and trust in delivered data products
Monitor pipelines and data refreshes, respond to failures, and escalate issues appropriately while contributing to root cause analysis and corrective actions
Support performance improvements through best practices such as partitioning, indexing, and efficient query patterns, with guidance from senior engineers
Follow security and governance practices by using approved access controls, handling sensitive data appropriately, and supporting audit and documentation needs
Contribute to continuous improvement by identifying opportunities to automate manual steps, improve monitoring, and strengthen reliability and maintainability

Qualification

Data EngineeringPythonSQLELT PipelinesData WarehousingAWSMicrosoft FabricQlikApache AirflowDockerData GovernanceSoft Skills

Required

Associate's degree in Computer Science, Information Systems, or a related field, or equivalent professional experience
1–3 years of hands-on experience in data engineering, data integration, or a related technical role, including internships, co ops, academic projects, or professional experience in data engineering, software development, analytics engineering, or a related area
Proficiency in Python for data processing, automation, and scripting
Proficiency in building ELT pipelines, including scheduling, incremental loads, and error handling
Proficiency with SQL based transformation
Familiarity with data warehousing or data lake concepts, including curated datasets, dimensional modeling basics, and common file formats such as Parquet and CSV
Ability to troubleshoot pipeline failures, analyze root causes, and communicate clearly with technical and nontechnical stakeholders
Demonstrated ability to work effectively as part of a collaborative, cross-functional team

Preferred

Bachelor's degree in Computer Science, Data Engineering, or related discipline
Exposure to orchestration tools such as Apache Airflow
Exposure to AWS, Microsoft Fabric, and Qlik architecture
Exposure to metadata management and data catalogs
Familiarity with container concepts such Docker
Exposure to supporting analytics or machine learning efforts by helping prepare curated, reliable datasets
Understanding of basic data governance and security concepts, including identity and access management and least privilege access
AWS Certified Data Engineer – Associate
Microsoft Fabric Analytics Engineer Associate (DP-600)
PCAP Python Certification
HashiCorp Terraform Associate
Docker Certified Associate
Apache Airflow Fundamentals

Company

William & Mary Libraries

twitter
company-logo
William & Mary Libraries support and enhance teaching and research, and foster intellectual curiosity, creativity and lifelong learning.

H1B Sponsorship

William & Mary Libraries has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (71)
2024 (39)
2023 (34)
2022 (31)
2021 (22)
2020 (31)

Funding

Current Stage
Late Stage
Company data provided by crunchbase