Circana · 3 hours ago
Big Data Engineer
Circana is a global company dedicated to fostering inclusivity and belonging. They are seeking a seasoned Factory Data Engineer to lead the development of scalable data solutions in a cloud-native environment, focusing on designing robust data pipelines and optimizing data warehouse performance.
Market Research
Responsibilities
Create Python, Spark, Perl, Shell Scripting programs to process data sets
Maintain existing Python, Spark, Perl, Shell Scripts and C programs
Collaborate with cross-functional teams to understand data requirements and deliver high-quality solutions
Learn and work extensively with in-house data tools and frameworks, contributing to their enhancement and integration
Ensure data quality, governance, and security across all data assets
Mentor junior engineers and promote best practices in data engineering
Drive performance tuning, cost optimization, and automation of data workflows
Participate in Agile ceremonies, code reviews, and technical design discussions
Create required documentation and Provide interface documentation to other team members on interfaces
Follow established SOPs and practices
Validate data generated to confirm that desired values are created
Qualification
Required
Bachelor's degree or equivalent in computer science
Minimum 5 years of experience in Python, Perl, C programming languages
Good understanding of Spark and pySpark
Good understanding of databases such as Hive, Postgres or Oracle
Should be familiar with scheduling tools such as Airflow or Control-M
A passion for technology and insatiable appetite to learn, learn-it-all attitude
Strong communication skills, ability to write technical docs and present ideas
Benefits
Paid time off
Medical/dental/vision insurance
401(k)
Company
Circana
Circana consults on the complexities of customer behavior.
H1B Sponsorship
Circana has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (53)
2024 (37)
2023 (32)
Funding
Current Stage
Late StageTotal Funding
$1.2BKey Investors
Vestar Capital Partners
2024-04-23Private Equity· $1.2B
Recent News
2025-12-10
Food Business News
2025-11-21
Company data provided by crunchbase