DataPelago · 3 months ago
Sr. Compiler Engineer
DataPelago is at the forefront of revolutionizing data processing for traditional analytics and cutting-edge GenAI preprocessing. As a Senior Compiler Engineer, you will lead the advancement of compilers for DataPelago’s data processing engine, enhancing its performance, scale, and reliability on diverse hardware infrastructures.
AnalyticsHardwareSoftware
Responsibilities
Lead the architecture of how our data processing engine will translate data processing logical and physical plans into efficient code for execution on CPU/GPU/FPGA
Lead design of functional and performance enhancements to the compilers in our data processing engine
Individually design, implement, test, optimize, and maintain components of compilers for the data processing engine
Analyze advances in the capabilities of CPU and GPU processing elements from Nvidia, AMD, Intel, and others, compiler platforms and tools and identify opportunities for our engine to enhance technology and product leadership
Partner effectively with engineering and product management in defining language specifications of our product and ensuring compliance with industry standards, platform definitions, and workload requirements
Foster best practices in design and code reviews, testing, CI/CD, and issue resolution to maintain highest product quality, security, efficiency, & productivity
Qualification
Required
Bachelor's degree in Computer Science or a related field with 7+ years of relevant experience OR a Master's degree in Computer Science or a related field with 5+ years of relevant experience
5+ years of deep technical experience in developing and enhancing production-quality compilers, tools, or related software
Demonstrated experience with auto-vectorization compiler technologies and data-parallel architectures
Demonstrated experience with compiler internals. Solid experience with GCC/LLVM/MLIR
Demonstrated experience with parsing, IR, type systems, and static analysis. Solid experience with flex/yacc/ANTLR
Exceptional programming skills in C, C++
Extensive development experience in Linux environments
Strong analytical and problem-solving skills with a passion for performance optimization
Preferred
Experience with compilation for data applications (e.g., query compilers, query planners), data processing languages (e.g., SQL, Python), acceleration hardware (e.g., Nvidia GPU), and data processing engines (e.g., Apache Spark, Presto)
Rust experience
Benefits
Competitive compensation
Stock options
Comprehensive benefits package
Leadership development opportunities
Company
DataPelago
DataPelago is a software development company that offer big data analytics solutions.
H1B Sponsorship
DataPelago has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (2)
2024 (3)
2023 (7)
2022 (1)
2021 (3)
Funding
Current Stage
Growth StageTotal Funding
$55MKey Investors
Eclipse VenturesTaiwania Capital Management Corporation
2024-10-01Series A· $47M
2022-10-06Series A
2021-04-30Seed· $8M
Recent News
Best Data Management Software, Vendors and Data Science Platforms
2025-08-23
solutionsreview.com
2025-08-23
Company data provided by crunchbase