Software Guidance & Assistance, Inc. (SGA, Inc.) · 3 hours ago
Sr. Data Engineer
Hartford, CT
Full-time
Onsite
Senior Level
$62/hr - $62/hr
7+ years expSoftware Guidance & Assistance, Inc. (SGA) is seeking a Sr. Data Engineer for a contract assignment with a premier Insurance client. The role involves modernizing legacy data assets, designing and optimizing ETL/ELT pipelines, and implementing DataOps practices to support advanced analytics and machine learning initiatives.
Information TechnologyStaffing Agency
Responsibilities
Modernize legacy data assets by migrating and re-engineering them into modern cloud solutions (AWS, GCP, Snowflake) for scalability, security, and cost efficiency
Design, develop, and optimize ETL/ELT pipelines for structured and unstructured data, ensuring resilience and high performance
Build and manage data pipelines leveraging cloud services such as AWS Glue, EMR, Redshift; GCP BigQuery, Dataflow; and Snowflake
Curate and publish Data Products to support analytics, visualization, machine learning, and Generative AI use cases
Implement DataOps practices for automated deployments, CI/CD integration, and continuous delivery of data solutions
Apply best practices for data modeling, governance, and security, ensuring compliance with enterprise standards and regulatory requirements
Establish and enforce Data Governance frameworks, including: Data Quality Management, Metadata Management, Data Lineage Tracking
Integrate AI/ML models into data pipelines, enabling real-time scoring, feature engineering, and model retraining workflows
Enable Generative AI capabilities by embedding LLMs into data workflows for intelligent automation and advanced insights
Develop and deploy AI Agents for automated decision-making and conversational analytics
Lead Proof of Concepts (POCs) and pilot initiatives for emerging technologies—beyond GenAI—such as real-time streaming, AI agents, and next-gen data platforms
Develop and maintain BI dashboards and visualization solutions using tools like Power BI or Tableau to deliver actionable insights
Monitor and fine-tune data pipelines for performance, scalability, and reliability using advanced observability tools
Automate auditing, reconciliation, and data quality checks to maintain high data integrity
Develop self-healing pipelines with robust re-startability mechanisms for resilience
Schedule and orchestrate complex workflows using tools like MWAA, Autosys, or Control-M
Champion continuous improvement and innovation by adopting emerging technologies in DataOps, AI/ML, and cloud engineering
Qualification
Required
Bachelor's or master's degree in computer science or a related discipline
7+ years of experience in data analysis, transformation, and development, with ideally 2+ years in the insurance or a related industry
5+ years of strong proficiency in SQL, Python, and ETL tools such as Informatica IDMC for data integration and transformation
3+ years of experience developing and deploying large-scale data and analytics applications on cloud platforms such as AWS, GCP and Snowflake
Experience in small or medium-scale Generative AI (GenAI) integration within data workflows or enterprise solutions
3+ years of expertise in designing and optimizing data models for Data Warehouses, Data Marts, and Data Fabric, including dimensional modeling, semantic layers, metadata management, and integration for scalable, governed, and high-performance analytics
3+ years of experience processing large-scale structured and unstructured data in both batch and near-real-time environments, leveraging distributed computing frameworks and streaming technologies for high-performance data pipelines
3+ years of experience in Agile methodologies, including Scrum and Kanban frameworks
2+ years of experience in leveraging DevOps pipelines for automated testing and deployment, ensuring continuous integration and delivery of data solutions
Experience accessing and retrieving data from disparate large data sources
Proficient in data visualization tools such as Tableau and Power BI, with expertise in creating interactive dashboards, reports, and visual analytics to support data-driven decision-making
Ability to analyze source systems, provide business solutions, and translate these solutions into actionable steps
Preferred
Knowledge of data observability (metrics, tracing, logs) and monitoring frameworks
Exposure to metadata management (catalogs, glossary) and data lineage tools
Familiarity with containerization & orchestration (Docker, Kubernetes)
Company
Software Guidance & Assistance, Inc. (SGA, Inc.)
SGA is the technology and resource solutions provider driven to stand out. We are a certified women-owned business.
201-500 employees
H1B Sponsorship
Software Guidance & Assistance, Inc. (SGA, Inc.) has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (13)
2024 (12)
2023 (19)
2022 (25)
2021 (41)
2020 (44)
Funding
Current Stage
Growth StageLeadership Team
Peter Taylor
CEO
Andrew Gallagher - CCWP
Senior Vice President - Strategic Partnerships
Company data provided by crunchbase