Call Quest Solution ยท 2 hours ago
Data Engineer
Call Quest Solution is a company focused on transforming financial transaction data into business insights and regulatory reports. They are seeking a Data Engineer to design and build scalable, automated data pipelines that convert on-prem Kafka streams into analytics and regulatory outputs using AWS cloud services.
Staffing & Recruiting
Responsibilities
Design, develop, and maintain ETL pipelines using AWS services
Process data from Kafka streams and S3 to generate actionable insights
Implement data transformations using Python, PySpark, and PyAthena
Build and optimize data models for analytics and regulatory reporting
Develop automated data quality checks and monitoring
Troubleshoot and resolve pipeline and data issues
Contribute to data architecture and infrastructure decisions
Ensure solutions meet performance, security, and compliance standards
Continuously improve scalability and reduce operational overhead
Maintain clear documentation for pipelines and processes
Qualification
Required
Bachelor's or Master's degree in Computer Science or related field
3+ years professional software engineering experience using: Python (primary language, not scripting only), PySpark, PyAthena
Strong experience with Pandas and/or NumPy
Solid understanding of ETL processes and data warehousing
Hands-on AWS experience: S3, Glue, Athena, EMR
Strong SQL and database fundamentals
Experience with ELK Stack (Elasticsearch, Logstash, Kibana)
1+ year experience working with Linux
Strong analytical mindset and business acumen
Excellent written and verbal communication skills
Preferred
Experience in financial markets or brokerage environments
Experience with Tableau or BI tools
Git / Bitbucket version control
CI/CD tools and practices
Company
Call Quest Solution
At Call Quest Solutions, we believe great companies are built by great people.
Funding
Current Stage
Growth StageCompany data provided by crunchbase