148 applicants

Company

Beyondsoft · 7 hours ago

Data Engineer

United States

Full-time

Remote

Senior Level, Lead/Staff

8+ years exp

Maximize your interview chances

ConsultingInformation Technology

Hiring Manager

Jigmin Panchal

Insider Connection @Beyondsoft

Discover valuable connections within the company who might provide insights and potential referrals.
Get 3x more responses when you reach out via email instead of LinkedIn.

Responsibilities

Respond to internal customer requests, bug fixes and ongoing performance optimizations to maintain data pipeline health and availability

Support internal partners with data analysis. Communicate with internal partner teams to troubleshoot issues and build new data assets: share insights, learnings and recommendations, best practices.

Build additional data pipelines as needed. Maintain data quality and integrity.

Maintain and improve data pipeline health, monitoring and alerting systems to meet and

Improve SLA for existing data pipelines

Ensure tools, data pipelines and data adhere to the latest privacy and security compliance guidelines.

Identify requirements for reports, scorecards, self-serve tools, etc. to help product teams monitor health and business performance of features with each release.

Identify requirements for data stream telemetry, manage data classifications

Processing to data storage systems for engineering teams and evaluate improvements from internal partner teams to data pipeline availability and health monitoring

Automate and streamline regular reports and BI processes including visualization tools like

Improve existing health and alerting systems with real-time data signal processing

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

Big Data ProcessingAzure Data ExplorerKusto Query LanguageAzure Data LakePowerBI VisualizationsData Pipeline Health MonitoringData Quality ManagementComputer Science DegreeComputer Engineering DegreeU-SQL

Required

Should have bachelor's degree in a technical field such as computer science, computer engineering or related field required.

Should have 8-10 overall years of experience in the field.

Should have a minimum 3+ years of experience with processing big data and building system health reports for near real-time and batch data.

Should have a minimum 4+ years of experience with Azure Data Explorer (Kusto) and Azure Data Lake (Cosmos).

Should have a minimum 4+ years of experience with Kusto Query Language and Cosmos scripts, as these are the primary programming languages to be used.

Should have 2-4 years of experience processing big data and building system health reports for warm path / near-real time and cold / batch processed data.

Should have experience with Azure Data Explorer / Kusto and Azure Data Lake / Cosmos.

Should have experience with Kusto Query Language and U-SQL / Cosmos scripts to process big data facts and build out intermediate summary tables.

Should have experience building PowerBI visualizations from health and usage data aggregated from customer telemetry data pipelines.

Company

Beyondsoft

Glassdoor

3.2

Beyondsoft Consulting is a leading business IT and consulting company that combines emerging technologies and proven methodologies to tailor solutions that move your business forward.

Founded in 1995

Singapore, Central Region, SGP

501-1000 employees