QuantumBlack, AI by McKinsey · 7 hours ago
Data Engineer II - QuantumBlack, AI by McKinsey
New York, NY
Full-time
Hybrid
Mid, Senior Level
2+ years expQuantumBlack, AI by McKinsey is a global leader in advanced analytics and AI solutions. As a Data Engineer II, you will design and optimize data platforms, collaborate with interdisciplinary teams, and ensure data is production-ready to drive digital transformations for clients.
AnalyticsArtificial Intelligence (AI)ConsultingData VisualizationInformation TechnologySoftwareSoftware Engineering
Responsibilities
Design, build, and optimize modern data platforms that power advanced analytics and AI solutions
Collaborate with clients and interdisciplinary teams to architect scalable pipelines, manage secure and compliant data environments, and unlock the value of complex datasets across industries
Develop a streaming data platform to integrate telemetry for predictive maintenance in aerospace systems
Implement secure data pipelines that reduce time-to-insight for a Fortune 500 utility company
Optimize large-scale batch and streaming workflows for a global financial services client, cutting infrastructure costs while improving performance
Develop pipelines for embeddings and vector databases to enable retrieval-augmented generation (RAG) for a global defense client
Work in cross-functional Agile teams with Data Scientists, Machine Learning Engineers, Designers, and domain experts to deliver high-quality analytics solutions
Partner closely with clients—from data owners to C-level executives—to shape data ecosystems that drive innovation and long-term resilience
Qualification
Required
Degree in Computer Science, Business Analytics, Engineering, Mathematics, or related field
2+ years of professional experience in data engineering, software engineering, or adjacent technical roles
Proficiency in Python, Scala, or Java for production-grade pipelines, with strong skills in SQL and PySpark
Hands-on experience with cloud platforms such as (AWS, GCP, Azure, Oracle) and modern data storage/warehouse solutions such as Snowflake, BigQuery, Redshift, and Delta Lake
Practical experience with Databricks, AWS Glue, and transformation frameworks like dbt, Dataform, or Databricks Asset Bundles
Knowledge of distributed systems such as (Spark, Dask, Flink) and streaming platforms (Kafka, Kinesis, Pulsar) for real-time and batch processing
Familiarity with workflow orchestration tools such as (Airflow, Dagster, Prefect), CI/CD for data workflows, and infrastructure-as-code (Terraform, CloudFormation)
Understanding of DataOps principles including pipeline monitoring, testing, and automation, with exposure to observability tools such as Datadog, Prometheus, and Great Expectations
Exposure to ML platforms such as (Databricks, SageMaker, Vertex AI), MLOps best practices, and GenAI toolkits (LangChain, LlamaIndex, Hugging Face)
Willingness to travel as required
Strong communication, time management, and resilience, with the ability to align technical solutions to business value
Preferred
Familiarity with vector databases and understanding of low latency serving patterns is a plus
Benefits
World-class benefits
Comprehensive benefits package
Company
QuantumBlack, AI by McKinsey
We are QuantumBlack, AI by McKinsey.
1001-5000 employees
H1B Sponsorship
QuantumBlack, AI by McKinsey has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (612)
2024 (647)
2023 (613)
2022 (811)
2021 (740)
2020 (471)
Funding
Current Stage
Late StageTotal Funding
unknown2015-12-14Acquired
Leadership Team
Rory Walsh
Senior Director
Recent News
Tech Startups - Startups and Technology news
2025-10-10
Tech Funding News
2025-10-09
2025-09-17
Company data provided by crunchbase