Lead PySpark Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Alpha Consulting Corp. · 1 month ago

Lead PySpark Engineer

positionOwings Mills, MD, MD
timeFull-time
remoteOnsite
seniorityLead/Staff
date10+ years exp

Alpha Consulting Corp. is seeking a Lead PySpark Engineer to join their team. The role involves leading data engineering efforts, focusing on big data and distributed computing using PySpark and AWS cloud platforms.

ConsultingPharmaceuticalStaffing Agency
check
Growth OpportunitiesbadNo H1Bnote

Qualification

PySparkApache SparkPythonSQLNoSQL databasesData modelingETL workflowsAWSDevOpsCI/CD pipelinesContainerizationData securityGovernanceComplianceProblem-solvingTeam leadershipMentoring

Required

Applicants must be able to work directly for Artech on W2
10 years of experience in big data and distributed computing
Strong hands-on experience with PySpark, Apache Spark, and Python
Proficiency in SQL and NoSQL databases (DB2, PostgreSQL, Snowflake, etc.)
Proficiency in data modeling and ETL workflows
Experience with workflow schedulers like Airflow
Hands-on experience with AWS cloud-based data platforms
Strong problem-solving skills and ability to lead a team

Preferred

Experience in DevOps, CI/CD pipelines, and containerization (Docker, Kubernetes)
Experience with data security, governance, and compliance
Mentoring experience with junior developers

Company

Alpha Consulting Corp.

twittertwitter
company-logo
Alpha Consulting Corp. has been exceeding expectations in the IT, pharmaceutical, and clinical staffing business since 1994.
dateFounded in 1994
location
East Brunswick, New Jersey, USA
people-size201-500 employees
web-link
http://alphaconsulting.com

Funding

Current Stage
Growth Stage
Company data provided by crunchbase