Bitsight · 6 hours ago
Senior Data Engineer
Maximize your interview chances
Insider Connection @Bitsight
Get 3x more responses when you reach out via email instead of LinkedIn.
Responsibilities
Optimize data flows and collection, thereby improving the efficiency, capacity and reliability of our data operations
Implement processes and systems to monitor data quality, ensuring production data is always accurate and available
Bringing innovation in the scalable data pipeline and infrastructure development and maintenance
Add new sources, code business rules, and produce new metrics that support data science and security research
Create and implement code, along with unit/integration tests, and applies coding patterns, guidelines, styles, and best practices; and adheres to all other requirements
Contribute to data science and engineering internal documents and roadmap development
Work closely with all business units and engineering teams to develop a strategy for long-term data architecture
Independently and consistently delivering high-quality data engineering support to the data scientists and security researchers.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
More than 5 years of experience as a Software/Data Engineer, with significant experience working on SaaS products.
Strong academic background in quantitative field (Computer Science, Engineering or Applied Mathematics)
Proficient in managing and developing scalable data pipelines and automation of data workflows using Python & Spark / Scala.
In-depth knowledge of AWS infrastructure and technology stacks for handling large datasets and table formats in a data lake environment.
Experience in data models, data warehousing, building and optimizing ETL pipelines
Deep understanding and experience of orchestration tools, CI/CD paradigms, and SDLC best practices.
Proven experience with SQL/NoSQL data warehouses.
Skilled at optimizing large datasets and developing operational processes that improve data quality.
Familiarity with container technologies such as Docker and Kubernetes.
Experience in managing and communicating data warehouse plans.
Ability to clearly present findings to business leaders and technical stakeholders
Preferred
Previous Experience in working closely with data scientists and cross-functional teams, supporting and driving innovation and research initiatives
An understanding of agile methodologies and an ability to adapt in a fast-paced, dynamic environment.
Experience in transforming complex, large-scale datasets into actionable insights.
Exposure to Machine Learning Operations (MLOps) strategies and architectures.
Forward-thinking mentality, not afraid to venture into uncharted territories and eagerly taking on any other tasks that might arise.
Benefits
Medical, dental, and vision insurance
Paid parental leave
Flexible time off
A 401(k) plan with employee and company contribution opportunities
Life and disability insurance
Tuition reimbursement
Company
Bitsight
Bitsight is a cyber risk management company for the financial, healthcare, and technology industries.
H1B Sponsorship
Bitsight has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (6)
2022 (8)
2021 (9)
2020 (7)
Funding
Current Stage
Late StageTotal Funding
$399MKey Investors
Moody's Investors ServiceWarburg PincusNotable Capital
2021-09-13Corporate Round· $250M
2018-06-28Series D· $60M
2016-09-15Series C· $40M
Recent News
Company data provided by crunchbase