IQVentures · 1 day ago
Data Engineer – ETL & Cloud Data Platforms
Columbus, Ohio Metropolitan Area
Full-time
Onsite
Mid Level
3+ years expIQVentures is an established, profitable technology and financial services company serving clients nationwide. They are seeking a highly skilled Data Engineer focused on building, optimizing, and maintaining enterprise-grade ETL/ELT pipelines using AWS Glue and Databricks to support business intelligence and advanced analytics.
Call CenterCustomer Service
No H1B
Responsibilities
Build, optimize, and operate scalable ETL/ELT pipelines using AWS Glue, Databricks, Spark, and Amazon S3
Transform raw, structured, and semi-structured data into analytics-ready datasets that power BI, reporting, and advanced analytics
Design and maintain modern lakehouse architectures, including bronze, silver, and gold data layers
Develop Spark workloads using Python (PySpark) and SQL, leveraging Delta Lake features such as ACID transactions, schema evolution, and time travel
Automate and orchestrate reliable data workflows using Glue Workflows, Step Functions, Databricks Jobs, or equivalent tools
Optimize performance, reliability, and cost across clusters, jobs, and pipelines
Implement monitoring, logging, alerting, and recovery processes to ensure pipeline health and data quality
Apply strong data governance and security practices, including IAM, encryption, access controls, validation, lineage tracking, and compliance support (SOX, PCI, SOC2)
Collaborate closely with Analytics, BI, Data Science, and Application teams to translate business needs into scalable data solutions
Participate in code reviews and architecture discussions, contributing to platform standards and best practices
Qualification
Required
3+ years of experience in data engineering, ETL development, or cloud data platforms
Hands-on experience with AWS Glue, Databricks, and Apache Spark
Strong proficiency in Python (PySpark) and SQL
Experience building and managing data lakes on Amazon S3
Understanding of data modeling concepts, including star schema and dimensional modeling
Experience with Delta Lake, lakehouse architecture, and/or Unity Catalog
Familiarity with orchestration tools such as AWS Step Functions, Airflow, or equivalents
Knowledge of streaming pipelines (Kafka, Kinesis, Auto Loader) is a plus
Experience working with version control (Git), CI/CD pipelines, and infrastructure as code (Terraform or CloudFormation)
Comfort working in regulated environments such as financial services, healthcare, or PCI
Familiarity with CloudWatch and Databricks Job Monitoring
Strong troubleshooting and performance-tuning skills
Excellent problem-solving, communication, and collaboration skills
Ability to manage multiple priorities with a self-starter mindset and strong attention to detail
Passion for data quality, reliability, and well-designed platforms
Preferred
Databricks or AWS certifications are a plus
Benefits
401(k)
401(k) matching
Dental insurance
Health insurance
Life insurance
Paid time off
Vision insurance
Company
IQVentures
iQventures innovates, creates, and operates intelligent communications solutions.
201-500 employees
Funding
Current Stage
Growth StageCompany data provided by crunchbase