ApTask · 4 months ago
Azure Data Explorer Administrator
ApTask is a leading global provider of workforce solutions and talent acquisition services. They are seeking two Azure Data Explorer Administrators responsible for implementing and tuning ingestion pipelines, optimizing data structures, and establishing robust monitoring for ingestion failures and data anomalies.
Human ResourcesInformation TechnologySmall and Medium BusinessesStaffing Agency
Responsibilities
Review and validate the **Azure Data Explorer (ADX)** architecture to ensure scalability, resiliency, and performance. Recommend and implement approved changes to cluster sizing, partitioning strategies, and cache policies
Ensure integration of data pipelines such as Vector, Event Hubs, Azure Blob, Cribl, NiFI ensuring high throughput and fault tolerance
Develop and maintain “Kusto Query Language (KQL)” functions, materialized views, and time-series optimizations to support advanced querying and SIEM use cases
Ensure all data ingestion flows are monitored end-to-end, with alerting and logging for failures, latency issues, or schema mismatches
Build and maintain data quality monitoring dashboards to identify missing, delayed, malformed, or duplicate events, and proactively address anomalies
Implement and document data normalization practices, including alignment with schema standards like OCSF when applicable
Configure and maintain role-based access control (RBAC) and ensure compliance with corporate data governance and security standards
Provide cost visibility and optimization strategies, including usage tracking, retention tuning, and query performance analysis
We need two Azure Data Explorer Administrators to ensure ADX is deployed, configured, and optimized as the core log analytics and SIEM data platform
These individuals will be responsible for implementing and tuning ingestion pipelines from multiple sources, optimizing data structures and queries for performance, and establishing robust monitoring for ingestion failures, data anomalies, and operational health
Their expertise will be critical in ensuring the reliability, scalability, and security of ADX in support of a modern, cloud-native SIEM modernization initiative
Qualification
Required
Review and validate the Azure Data Explorer (ADX) architecture to ensure scalability, resiliency, and performance
Recommend and implement approved changes to cluster sizing, partitioning strategies, and cache policies
Ensure integration of data pipelines such as Vector, Event Hubs, Azure Blob, Cribl, NiFI ensuring high throughput and fault tolerance
Develop and maintain 'Kusto Query Language (KQL)' functions, materialized views, and time-series optimizations to support advanced querying and SIEM use cases
Ensure all data ingestion flows are monitored end-to-end, with alerting and logging for failures, latency issues, or schema mismatches
Build and maintain data quality monitoring dashboards to identify missing, delayed, malformed, or duplicate events, and proactively address anomalies
Implement and document data normalization practices, including alignment with schema standards like OCSF when applicable
Configure and maintain role-based access control (RBAC) and ensure compliance with corporate data governance and security standards
Provide cost visibility and optimization strategies, including usage tracking, retention tuning, and query performance analysis
Implementing and tuning ingestion pipelines from multiple sources
Optimizing data structures and queries for performance
Establishing robust monitoring for ingestion failures, data anomalies, and operational health
Ensuring the reliability, scalability, and security of ADX in support of a modern, cloud-native SIEM modernization initiative
Company
ApTask
ApTask is a staffing and recruiting company offering staffing, project, and workforce solutions.
H1B Sponsorship
ApTask has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (1)
2020 (1)
Funding
Current Stage
Growth StageRecent News
Company data provided by crunchbase