Cargill · 6 hours ago
Manager, Data Engineering
Atlanta, GA
Full-time
Onsite
Mid, Senior Level
4+ years expCargill is a family company providing essential food and agricultural products globally. The Manager, Data Engineering will lead a team responsible for designing and maintaining robust data systems that enable effective data analysis and reporting, ensuring efficient processing and accessibility of large data sets for decision-making.
AgricultureFood and BeverageFood ProcessingManufacturingMeat and Poultry
Responsibilities
Oversees the development of data products and solutions using big data and cloud based technologies, ensuring they are designed and built to be scalable, sustainable and robust
Develops and monitors streaming and batch data pipelines that facilitate the seamless ingestion of data from various data sources, transform the data into information and move to data stores like data lake, data warehouse and others
Reviews existing data systems and architectures to lead identification of areas for improvement and optimization
Oversees the preparation of data infrastructure to drive the efficient storage and retrieval of data
Reviews and resolves appropriate data formats to improve data usability and accessibility across the organization
Partners collaboratively with multi-functional data and advanced analytic teams to capture requirements and ensure that data solutions meet the functional and non-functional needs of various partners
Builds complex prototypes to test new concepts and provides guidance to implement data engineering frameworks and architectures that improve data processing capabilities and support advanced analytics initiatives
Oversees the development of automated deployment pipelines improving efficiency of code deployments with fit for purpose governance
Guides the team to perform data modeling in accordance to the datastore technology to ensure sustainable performance and accessibility
Manages team members to achieve the organization’s goals, by ensuring productivity, communicating performance expectations, creating goal alignment, giving and seeking feedback, providing coaching, measuring progress and holding people accountable, supporting employee development, recognizing achievement and lessons learned, and developing enabling conditions for talent to thrive in an inclusive team culture
Qualification
Required
Minimum requirement of 4 years of relevant work experience
Typically reflects 5 years or more of relevant experience
Preferred
Experience with data engineering on corporate finance data is strongly preferred
Familiarity with major cloud platforms (AWS, GCP, Azure)
Experience with modern data architectures, including data lakes, data lakehouses, and data hubs, along with related capabilities such as ingestion, governance, modeling, and observability
Proficiency in data collection, ingestion tools (Kafka, AWS Glue), and storage formats (Iceberg, Parquet)
Knowledge of streaming architectures and tools (Kafka, Flink)
Strong background in data transformation and modeling using SQL-based frameworks and orchestration tools (dbt, AWS Glue, Airflow). Experience with modeling concepts like SCD and schema evolution
Familiarity with using Spark for data transformation, including streaming, performance tuning, and debugging with Spark UI
Proficient with programming in Python, Java, Scala, or similar languages
Expert-level proficiency in SQL for data manipulation and optimization
Demonstrated experience in DevOps practices, including code management, CI/CD, and deployment strategies
Understanding of data governance principles, including data quality, privacy, and security considerations for data product development and consumption
Company
Cargill
Cargill provides agricultural, food, bioindustrial, and risk management solutions across global supply chains and manufacturing sectors.
10001+ employees
H1B Sponsorship
Cargill has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (25)
2024 (25)
2023 (29)
2022 (31)
2021 (26)
2020 (41)
Funding
Current Stage
Late StageTotal Funding
$0.02MKey Investors
National Safety Council
2025-06-25Grant· $0.02M
Leadership Team
Brian Sikes
Board Chair and CEO
David MacLennan
Chairman & Chief Executive Officer
Recent News
FoodProcessing.com
2025-12-30
2025-12-26
Company data provided by crunchbase