Data Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Call Quest Solution ยท 2 hours ago

Data Engineer

Call Quest Solution is a company focused on transforming financial transaction data into business insights and regulatory reports. They are seeking a Data Engineer to design and build scalable, automated data pipelines that convert on-prem Kafka streams into analytics and regulatory outputs using AWS cloud services.

Staffing & Recruiting

Responsibilities

Design, develop, and maintain ETL pipelines using AWS services
Process data from Kafka streams and S3 to generate actionable insights
Implement data transformations using Python, PySpark, and PyAthena
Build and optimize data models for analytics and regulatory reporting
Develop automated data quality checks and monitoring
Troubleshoot and resolve pipeline and data issues
Contribute to data architecture and infrastructure decisions
Ensure solutions meet performance, security, and compliance standards
Continuously improve scalability and reduce operational overhead
Maintain clear documentation for pipelines and processes

Qualification

PythonAWSETL processesPySparkSQLKafkaPandasNumPyELK StackLinuxAnalytical mindsetCommunication skills

Required

Bachelor's or Master's degree in Computer Science or related field
3+ years professional software engineering experience using: Python (primary language, not scripting only), PySpark, PyAthena
Strong experience with Pandas and/or NumPy
Solid understanding of ETL processes and data warehousing
Hands-on AWS experience: S3, Glue, Athena, EMR
Strong SQL and database fundamentals
Experience with ELK Stack (Elasticsearch, Logstash, Kibana)
1+ year experience working with Linux
Strong analytical mindset and business acumen
Excellent written and verbal communication skills

Preferred

Experience in financial markets or brokerage environments
Experience with Tableau or BI tools
Git / Bitbucket version control
CI/CD tools and practices

Company

Call Quest Solution

twitter
company-logo
At Call Quest Solutions, we believe great companies are built by great people.

Funding

Current Stage
Growth Stage
Company data provided by crunchbase