JPS Tech Solutions · 8 hours ago
Data Engineer
JPS Tech Solutions is seeking a Senior Data Engineer to join their onsite data engineering team. The role involves supporting large-scale cloud migration and data platform modernization initiatives, requiring expertise in Databricks, PySpark, SQL, and AWS-based ETL pipelines.
Information TechnologyIT InfrastructureSoftware Engineering
Responsibilities
Design, develop, and maintain scalable ETL/ELT pipelines using Databricks and Apache Spark (PySpark)
Lead and support migration of data pipelines and applications from on-premises environments to AWS
Build robust data ingestion frameworks for structured, semi-structured, and unstructured data sources
Write, optimize, and maintain complex SQL queries across RDBMS, data lakes, and federated data environments
Review existing data solutions and recommend architectural improvements for performance, scalability, and maintainability
Develop reusable frameworks and components to standardize data processing patterns
Tune and optimize Spark jobs for performance and cost efficiency in cloud environments
Build, deploy, and support solutions end-to-end, from development through production
Implement CI/CD pipelines and follow version control best practices
Enforce data quality, validation, security, and governance standards
Collaborate with data architects, analysts, and business stakeholders to translate requirements into technical solutions
Participate in Agile ceremonies, including sprint planning, estimation, and retrospectives
Troubleshoot, debug, and resolve production pipeline issues
Take full ownership of solutions from design through production support
Qualification
Required
12+ years of overall IT experience with strong focus on data engineering
Hands-on expertise with Databricks SaaS, Python, and PySpark
Ability to independently design and build ETL pipelines
Expert-level SQL skills, including writing and optimizing complex queries
Strong experience with AWS-based ETL services, including: AWS Glue, EC2, EMR, Amazon S3
Solid understanding of Data Lake and Lakehouse architectures
Experience working with RDBMS and large-scale analytical datasets
Proven experience deploying production code using Git and CI/CD pipelines
Comfortable working onsite full-time in a collaborative team environment
Strong communication skills with a solution-oriented mindset
Ability to own solutions end to end, from architecture through operations
Bachelor's degree in Computer Science or equivalent professional experience
Company
JPS Tech Solutions
JPS Tech Solutions offers software engineering, cloud, mobile development, and IT infrastructure solutions.
Funding
Current Stage
Growth StageCompany data provided by crunchbase