Interactive Brokers ยท 5 hours ago
Data Engineer (Gen AI)
New York, NY
Full-time
Hybrid
Mid, Senior Level
$150K/yr - $200K/yr
4+ years expInteractive Brokers Group, Inc. is a global financial services company known for its cutting-edge technology and client commitment. They are seeking a Data Engineer to design, build, and maintain scalable data pipelines and analytics solutions, supporting enterprise-wide AI initiatives and advanced analytics capabilities.
E-CommerceFinanceFinancial Services
Responsibilities
Design, build, and maintain scalable data crawlers and ETL/ELT pipelines to ingest data from various sources including enterprise collaboration tools, web applications, and internal databases
Develop and manage data lake platform infrastructure including S3-based storage, Iceberg tables, AWS Glue data catalog, and cloud data warehouse solutions for analytics workloads
Build and optimize real-time streaming data pipelines using Kafka for event-driven analytics and data processing
Create and maintain data transformation pipelines to clean, curate, and prepare data for analytics and AI/ML applications, supporting multiple data formats including structured, semi-structured, and unstructured data (text, images, audio, video)
Develop Python-based applications for data ingestion, processing, and integration supporting Gen AI RAG workflows and knowledge base systems
Collaborate with internal development teams, data scientists, and stakeholders to understand requirements, architect appropriate data solutions, and create comprehensive technical documentation
Monitor, troubleshoot, and optimize data pipelines for performance, reliability, and data quality
Write clean, maintainable, well-tested code following software engineering and data engineering best practices
Create comprehensive technical documentation for data pipelines, architectures, and platform capabilities
Qualification
Required
4+ years of hands-on data engineering experience with modern data stack technologies
Strong experience with AWS cloud services, particularly: S3, AWS Glue, Athena, EMR, Lambda
Proficiency in Python for data processing, ETL, and application development
Experience with PySpark on EMR for large-scale data processing
Strong SQL skills for data analysis and transformation
Experience building and maintaining ETL/ELT pipelines at scale
Experience with Kafka for streaming data pipelines and real-time data processing
Knowledge of data lake architectures and modern table formats (e.g., Iceberg)
Experience with CI/CD practices using Git, version control systems, and containerization (Docker)
Understanding of data modeling, data warehousing concepts, and analytics best practices
Exceptional problem-solving and analytical skills
Excellent collaboration and communication (verbal and written) skills
Self-motivated with ability to work independently and manage multiple priorities
Willingness and enthusiasm to learn AI/ML technologies, stay current with emerging data engineering trends
Benefits
Competitive salary, annual performance-based bonus and stock grant
Retirement plan 401(k) with competitive company match
Excellent health and wellness benefits, including medical, dental, and vision benefits. Company paid medical healthcare premium.
Wellness screenings and assessments, health coaches and counseling services through an Employee Assistance Program (EAP)
Paid time off and a generous parental leave policy
Daily company lunch allowance provided and a fully stocked kitchen with healthy options for breakfast and snack
Corporate events including team outings, dinners, volunteer activities and company sports teams
Education reimbursement and learning opportunities
Modern offices with multi-monitor setups
Company
Interactive Brokers
Rated #1 Active Traders and #1 International Trading in 2025 by StockBrokers.com.
Founded in 1977Greenwich, Connecticut, USA
1001-5000 employees
H1B Sponsorship
Interactive Brokers has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (29)
2024 (24)
2023 (12)
2022 (21)
2021 (10)
2020 (12)
Funding
Current Stage
Public CompanyTotal Funding
unknown2009-06-01Post Ipo Equity
2008-01-01Post Ipo Equity
2007-05-04IPO
Leadership Team
James Menicucci
Chief Financial Officer
Andrew Claflin
Marketing Partnerships
Recent News
2026-01-09
2026-01-07
Company data provided by crunchbase