Starburst Data Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Tata Consultancy Services · 2 hours ago

Starburst Data Engineer

Tata Consultancy Services is seeking a Starburst Data Engineer to design and implement data virtualization solutions. The role involves optimizing query performance, analyzing data mapping documents, and ensuring data integrity through various validation processes.

Business Information SystemsConsultingInformation TechnologyIT Management
check
H1B Sponsor Likelynote

Responsibilities

Demonstrated expertise in Starburst Data Virtualization, including designing and implementing data virtualization solutions, optimizing query performance across distributed data sources, and integrating Starburst with enterprise data architectures
Analyze data mapping documents and business requirements to design comprehensive test plans and cases
Perform source-to-target data reconciliation, check data loading, and ensure transformation rules are applied correctly
Write complex SQL scripts for validation (count, data completeness, data consistency, data truncation)
Identify, log, and track data defects using tools like JIRA or HP ALM or Octane
Automate test scripts and validate data volume, performance, and scalability
Expert-level knowledge of SQL for data analysis
Experience with tools such as Informatica and IDMC
Understanding of data warehouse concepts and architectures (e.g., star/snowflake schema)
Familiarity with Hadoop or Spark is often preferred
Validate HiveQL, HDFS file structures, and data processing within the Hadoop cluster
Strong analytical and troubleshooting skills
Excellent communication for collaborating with developers and stakeholders

Qualification

StarburstData VirtualizationSQLDremioPrestoData WarehousingETL/ELTShell ScriptingAutosysInformaticaHadoopSparkKafkaAnalytical SkillsCommunication Skills

Required

Minimum 10 years of experience
Demonstrated expertise in Starburst Data Virtualization, including designing and implementing data virtualization solutions, optimizing query performance across distributed data sources, and integrating Starburst with enterprise data architectures
Analyze data mapping documents and business requirements to design comprehensive test plans and cases
Perform source-to-target data reconciliation, check data loading, and ensure transformation rules are applied correctly
Write complex SQL scripts for validation (count, data completeness, data consistency, data truncation)
Identify, log, and track data defects using tools like JIRA or HP ALM or Octane
Automate test scripts and validate data volume, performance, and scalability
Expert-level knowledge of SQL for data analysis
Experience with tools such as Informatica and IDMC
Understanding of data warehouse concepts and architectures (e.g., star/snowflake schema)
Validate HiveQL, HDFS file structures, and data processing within the Hadoop cluster
Strong analytical and troubleshooting skills
Excellent communication for collaborating with developers and stakeholders

Preferred

Familiarity with Hadoop or Spark
Domain: Banking knowledge, Payments knowledge preferred

Company

Tata Consultancy Services

company-logo
Tata Consultancy Services is a business solutions company that specializes on information technology services and consulting.

H1B Sponsorship

Tata Consultancy Services has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (7880)
2024 (9690)
2023 (8537)
2022 (11159)
2021 (9813)
2020 (11984)

Funding

Current Stage
Public Company
Total Funding
unknown
2004-08-25IPO

Leadership Team

leader-logo
K. Krithivasan
Chief Executive Officer & Managing Director
linkedin
leader-logo
Aarthi Subramanian
President and Chief Operating Officer
Company data provided by crunchbase