Incedo Inc. · 1 hour ago
Cloud Architect
Dallas, TX
Full-time
Onsite
Senior Level
6+ years expIncedo Inc. is seeking a Senior Technical Lead / Architect with strong expertise in AWS-based streaming data pipelines. The role involves designing and implementing scalable data ingestion and processing frameworks while ensuring data quality and operational efficiency.
AnalyticsConsultingFinancial ServicesIT ManagementLife ScienceSoftwareTelecommunications
Hiring Manager
Kousalya G
Responsibilities
Provide technical solution discovery effort on any new capabilities or new functionality
Assist PO with technical user stories to ensure healthy backlog features
Lead the development of real-time data pipelines using AWS DMS , MSK , Kafka or Glue Streaming and for CDC ingestion from multiple SQL Server sources (RDS/on-prem)
Build and optimize streaming and batch data pipelines using AWS Glue (PySpark) to validate, transform, and normalize data to Iceberg and DynamoDB
Define and enforce data quality, lineage, and reconciliation logic with support for both streaming and batch use cases
Integrate with S3 Bronze/Silver layers and implement efficient schema evolution and partitioning strategies using Iceberg
Collaborate with architects, analysts, and downstream application teams to design API and file-based egress layers
Implement monitoring, logging , and event-based alerting using CloudWatch, SNS, and EventBridge
Mentor junior developers and enforce best practices for modular, secure, and scalable data pipeline development
Qualification
Required
6+ years of hands-on expert level data engineering experience in cloud-based environments (AWS preferred) with event driven implementation
Strong experience with Apache Kafka / AWS MSK including topic design, partitioning, and Kafka Connect/Debezium
Proficiency in AWS Glue (PySpark) and for both batch and streaming ETL
Working knowledge of AWS DMS, S3, Lake Formation, DynamoDB, and Iceberg
Solid grasp of schema evolution, CDC patterns, and data reconciliation frameworks
Experience with infrastructure-as-code (CDK/Terraform) and DevOps practices (CI/CD, Git)
Preferred
Familiarity with PostgreSQL
Athena
Step Functions
Lambda
Knowledge of event-driven architectures and microservices-based data APIs (This should be the required skills)
Familiar with data lake concept
Familiar with Financial or Financial Wealth management data domain
Company
Incedo Inc.
Incedo is a New Jersey headquartered, digital, data analytics and technology services firm.
1001-5000 employees
H1B Sponsorship
Incedo Inc. has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (108)
2024 (145)
2023 (97)
2022 (114)
2021 (54)
2020 (67)
Funding
Current Stage
Late StageLeadership Team
Nitin Seth
Co-Founder and Chief Executive Officer
Recent News
Company data provided by crunchbase