Software Guidance & Assistance, Inc. (SGA, Inc.) ยท 1 day ago
Data Engineer - III
San Francisco, CA
Full-time
Onsite
Mid Level
$85/hr - $120/hr
3+ years expSoftware Guidance & Assistance, Inc. (SGA) is searching for a Data Engineer - III for a contract assignment with one of their premier Financial Services clients. The role involves collecting, managing, and analyzing large sets of data, designing and maintaining data pipelines, and collaborating with cross-functional teams to deliver high-quality data products and services.
Information TechnologyStaffing Agency
Hiring Manager
Hakim Vanderburg
Responsibilities
Responsible for collecting, parsing, managing, analyzing, and visualizing large sets of data to turn information into actionable insights
They will work across multiple platforms to ensure that data pipelines are scalable, repeatable, and secure, capable of serving multiple users
Design, develop, and maintain robust and efficient data pipelines to ingest, transform, catalog, and deliver curated, trusted, and quality data from disparate sources into our Common Data Platform
Actively participate in Agile rituals and follow Scaled Agile processes as set forth by the CDP Program team
Deliver high-quality data products and services following Safe Agile Practices
Proactively identify and resolve issues with data pipelines and analytical data stores
Deploy monitoring and alerting for data pipelines and data stores, implementing auto-remediation where possible to ensure system availability and reliability
Employ a security-first, testing, and automation strategy, adhering to data engineering best practices
Collaborate with cross-functional teams, including product management, data scientists, analysts, and business stakeholders, to understand their data requirements and provide them with the necessary infrastructure and tools
Keep up with the latest trends and technologies, evaluating and recommending new tools, frameworks, and technologies to improve data engineering processes and efficiencies
Qualification
Required
Bachelor's degree in Computer Science, Information Systems, or a related field, or equivalent experience
2+ years' experience with tools such as Databricks, Collibra, and Starburst
3+ years' experience with Python and PySpark
Experience using Jupyter notebooks, including coding and unit testing
Recent accomplishments working with relational and NoSQL data stores, methods, and approaches (STAR, Dimensional Modeling)
2+ years of experience with a modern data stack (Object stores like S3, Spark, Airflow, Lakehouse architectures, real-time databases) and cloud data warehouses such as RedShift, Snowflake
Overall data engineering experience across traditional ETL & Big Data, either on-prem or Cloud
Data engineering experience in AWS (any CFS2/EDS) highlighting the services/tools used
Experience building end-to-end data pipelines to ingest and process unstructured and semi-structured data using Spark architecture
Requires access to confidential supervisory information
Company
Software Guidance & Assistance, Inc. (SGA, Inc.)
SGA is the technology and resource solutions provider driven to stand out. We are a certified women-owned business.
201-500 employees
H1B Sponsorship
Software Guidance & Assistance, Inc. (SGA, Inc.) has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (13)
2024 (12)
2023 (19)
2022 (25)
2021 (41)
2020 (44)
Funding
Current Stage
Growth StageLeadership Team
Peter Taylor
CEO
Andrew Gallagher - CCWP
Senior Vice President - Strategic Partnerships
Company data provided by crunchbase