Texas or Virginia ----Data Engineer/ Data Analyst jobs in United States
cer-icon
Apply on Employer Site
company-logo

Cliff Services Inc ยท 2 days ago

Texas or Virginia ----Data Engineer/ Data Analyst

Cliff Services Inc is seeking a Data Engineer/Data Analyst with expertise in Python, PySpark, and AWS. The role involves designing, building, and maintaining scalable data pipelines in a cloud environment, collaborating with various teams to deliver effective data solutions.

Cloud ComputingCyber SecurityInformation TechnologySoftwareWeb Development
check
H1B Sponsor Likelynote
Hiring Manager
Hemanth Kumar
linkedin

Responsibilities

Design, develop, and maintain robust ETL/ELT pipelines using Python and PySpark for data ingestion, transformation, and processing
Work extensively with AWS cloud services such such as S3, Glue, EMR, Lambda, Redshift, Athena, and DynamoDB for data storage, processing, and warehousing
Build and optimize data ingestion and processing frameworks for large-scale data sets, ensuring data quality, consistency, and accuracy
Collaborate with data architects, data scientists, and business intelligence teams to understand data requirements and deliver effective data solutions
Implement data governance, lineage, and security best practices within data pipelines and infrastructure
Automate data workflows and improve data pipeline performance through optimization and tuning
Develop and maintain documentation for data solutions, including data dictionaries, lineage, and technical specifications
Participate in code reviews, contribute to continuous improvement initiatives, and troubleshoot complex data and pipeline issues

Qualification

PythonPySparkAWSSQLData modelingApache AirflowCI/CD pipelinesVersion control (Git)Analytical skillsKafkaKinesisSnowflakeProblem-solvingCommunication skillsTeamwork

Required

Strong programming proficiency in Python, including libraries like Pandas and extensive experience with PySpark for distributed data processing
Solid understanding and practical experience with Apache Spark/PySpark for large-scale data transformations
Demonstrated experience with AWS data services, including S3, Glue, EMR, Lambda, Redshift, and Athena
Proficiency in SQL and a strong understanding of data modeling, schema design, and data warehousing concepts
Experience with workflow orchestration tools such as Apache Airflow or AWS Step Functions
Familiarity with CI/CD pipelines and version control systems (e.g., Git)
Excellent problem-solving, analytical, and communication skills, with the ability to work effectively in a team environment

Preferred

Experience with streaming frameworks like Kafka or Kinesis
Knowledge of other data warehousing solutions like Snowflake

Company

Cliff Services Inc

twittertwittertwitter
company-logo
Cliff Services Inc is a IT services and technology consulting company into providing cutting-edge technology solutions to businesses.

H1B Sponsorship

Cliff Services Inc has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (7)
2024 (8)
2023 (5)

Funding

Current Stage
Growth Stage

Leadership Team

leader-logo
Pavan Jagarlamudi
Founder & CEO
linkedin
Company data provided by crunchbase