Software Engineer, Data Infrastructure (Hybrid) jobs in United States
cer-icon
Apply on Employer Site
company-logo

CrowdStrike · 14 hours ago

Software Engineer, Data Infrastructure (Hybrid)

CrowdStrike is a global leader in cybersecurity, dedicated to stopping breaches and providing advanced AI-native security solutions. The role involves building and operating systems for a hyper scale data lake, focusing on creating a scalable Spark ecosystem for data analytics and threat hunting.

Artificial Intelligence (AI)Cloud Data ServicesCloud SecurityCyber SecurityNetwork Security
check
Growth Opportunities
badNo H1BnoteU.S. Citizen Onlynote

Responsibilities

Design and implement extremely scalable large scale distributed Spark cluster on Kubernetes platform optimized for Data center environment
Perform and oversee a variety of functions to ensure that our Spark infrastructure on Kubernetes is available, reliable, stable and secure
Applies judgment in analyzing and selecting technologies, installation and maintenance of software and hardware systems that allow multiple Engineering and DataScience teams to interact with this system
Design, writes and own APIs, automate and generate reports to visualize cluster health
Has responsibility for building and maintaining the Spark infrastructure such that software engineers, data analysts and data scientists can run jobs to gather data and insights
Work on Query systems, like Apache Presto or Trino, Jupyter Notebooks

Qualification

Spark ecosystemKubernetes ecosystemDistributed SystemsProgramming GoProgramming JavaProgramming PythonApache Spark technologiesLarge-scale platformsContinuous deployment (K8)Spark storage systemsChefCommunication skills

Required

Strong in one or both of field i.e., Spark ecosystem or Kubernetes ecosystem
Strong analytical skills and with deep understanding of Distributed Systems
Strong programming skills in languages as Go, Java or Python
Understanding of Apache Spark ecosystem technologies (Deltalake/Iceberg, YARN, HDFS, Kafka, Zookeeper, Hive, Jupyter notebooks)
Experience with large-scale business critical platforms with Spark on Kubernetes on data center or cloud
Experience with continuous deployment on K8 with Helm, fluxCD etc
Solid understanding of Spark(data) and K8 storage systems (Object stores S3/Minio, Spark ephemeral storage, Persistent volumes mapping and claims)
Understanding or spark memory management and experience with spark internals
Proven ability to work with both local and remote teams
Strong communication skills both verbal and written

Preferred

Familiarity with Chef

Benefits

Market leader in compensation and equity awards
Comprehensive physical and mental wellness programs
Competitive vacation and holidays for recharge
Paid parental and adoption leaves
Professional development opportunities for all employees regardless of level or role
Employee Networks, geographic neighborhood groups, and volunteer opportunities to build connections
Vibrant office culture with world class amenities
Great Place to Work Certified™ across the globe
Health insurance
401k
Paid time off

Company

CrowdStrike

company-logo
CrowdStrike is a cybersecurity technology firm that provides cloud-delivered protection for cloud workloads, identity, and data.

Funding

Current Stage
Public Company
Total Funding
$1.24B
Key Investors
ARK Investment ManagementAccelCapitalG
2022-12-01Post Ipo Equity· $4.6M
2021-01-12Post Ipo Debt· $750M
2019-06-12IPO

Leadership Team

leader-logo
George Kurtz
President / CEO & Founder
linkedin
leader-logo
Zeki Turedi
Field CTO Europe
linkedin
Company data provided by crunchbase