Crunchbase · 12 hours ago
Senior Data Engineer
Crunchbase is a predictive solution that provides intelligence on private companies, powered by live private company data and AI. As a Senior Data Engineer, you will architect and implement robust data solutions to support organizational needs, collaborating with cross-functional teams to design and maintain data pipelines and optimize data storage and retrieval.
Artificial Intelligence (AI)B2BBig DataDatabaseInformation ServicesLead GenerationMarketingMobile AdvertisingSoftwareVideo
Responsibilities
Data Architecture and Design: Design and implement scalable and efficient data solutions. Collaborate with stakeholders to understand data requirements and translate them into effective solutions
Data Pipeline Development: Design, build, and optimize data pipelines for both batch and real-time processing. Ensure the seamless flow of data across systems, maintaining high standards for data quality and reliability
Data Modeling and Optimization: Develop and maintain data models that align with business needs and support analytics, generative AI, and ML workloads. Optimize data storage, processing, and retrieval for maximum efficiency and performance
Collaboration and Communication: Work closely with data scientists, analysts, and other stakeholders to understand their needs and provide data engineering support. Communicate complex technical concepts to non-technical team members effectively
Performance Monitoring and Troubleshooting: Implement monitoring solutions to proactively identify and address performance issues. Troubleshoot and resolve data-related problems in a timely manner
Technology Evaluation and Adoption: Stay abreast of industry trends and evaluate new tools and technologies to enhance our data capabilities. Make recommendations for technology adoption based on the organization's goals and objectives
Performs other related duties as assigned
Qualification
Required
4+ years of experience in data engineering with a focus on building scalable data solutions
Proficiency in Python
Experience with streaming data systems (e.g.: Kafka) and with using databases such as Postgres, Elasticsearch and Redis
Strong experience with data pipelines, ETL processes, and data warehousing
Strong background in developing end-to-end solutions in a production environment
Strong experience with data modeling, ETL processes, and data warehousing
Familiarity with containerization technologies (Docker, Kubernetes)
Experience with CI/CD tools and practices
Excellent problem-solving skills and a proactive approach to addressing challenges
Strong communication and interpersonal skills
Demonstrated curiosity and comfort using AI tools to enhance productivity and creativity
Ability to identify when and how to use AI responsibly while maintaining data privacy and accuracy
Preferred
Experience with Codex or other agentic/AI-assisted development tools is a plus
Experience with cloud platforms (e.g., AWS, Azure, GCP, Snowflake) is a plus
Benefits
Comprehensive health benefits for you and your family, including medical, dental, and vision coverage (PPO, HDHP, and HMO options)
Continuous learning support through generous reimbursement for professional development and skills growth
401(k) and Roth plans with an annual financial adviser check-in to help you plan your future
Wellness resources — including a monthly stipend to support physical and mental health
Work-from-home enablement — internet stipend and home office setup allowance
Charitable giving match through our Town Hall awards and community impact initiatives
Company
Crunchbase
Crunchbase is a predictive private company intelligence solution, powered by live company data, AI, and market activity from 80M+ users.
H1B Sponsorship
Crunchbase has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2024 (4)
2023 (1)
2022 (5)
2021 (6)
2020 (2)
Funding
Current Stage
Late StageTotal Funding
$106.5MKey Investors
Alignment GrowthOMERS VenturesMayfield Fund
2022-07-20Series D· $50M
2019-10-31Series C· $30M
2017-04-06Series B· $18M
Recent News
Crunchbase News
2026-02-06
Crunchbase News
2026-02-04
Company data provided by crunchbase