Quadrant IQ Solutions LLC · 1 day ago
Data Engineer
New York, NY
Full-time
Onsite
Senior LevelQuadrant IQ Solutions LLC is seeking a Senior Data Engineer with expertise in Spark and AWS. The role involves designing and optimizing high-performance data pipelines, maintaining ETL workflows, and managing data workloads in a cloud environment.
Information Technology & Services
Responsibilities
Design, build, and optimize high-performance Spark-based data pipelines using Python/PySpark
Develop and maintain ETL/ELT workflows for large-scale structured and semi-structured data
Deploy and manage data workloads on AWS ECS
Implement data ingestion, transformation, and governance using AWS Glue / Lake Formation
Integrate data pipelines with Snowflake or Teradata for analytics and reporting
Ensure scalability, reliability, and performance of distributed data processing systems
Collaborate with analytics, platform, and cloud engineering teams
Qualification
Required
Python & PySpark – Expert-level proficiency with very strong Apache Spark experience (large-scale data processing, optimization, performance tuning)
AWS Cloud
ECS (Elastic Container Service) – Required
Data Warehousing
Snowflake or Teradata (hands-on experience with large analytical datasets)
Preferred
AWS Glue and/or AWS Lake Formation – Strongly preferred
Company
Quadrant IQ Solutions LLC
Quadrant IQ Solutions was established with the foundational objective of transforming the manner in which individuals, businesses, enterprises, and industries leverage technological capabilities.
11-50 employees
H1B Sponsorship
Quadrant IQ Solutions LLC has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (3)
Funding
Current Stage
Early StageCompany data provided by crunchbase