NewsBreak · 2 weeks ago
Senior Software Engineer, Web
NewsBreak is a Content Intelligence platform shaping the future content economy, boasting over 40 million monthly active users. The role involves building and optimizing data acquisition infrastructure, focusing on web crawling and data processing to support critical business needs.
Advertising PlatformsArtificial Intelligence (AI)Content CreatorsSearch Engine
Responsibilities
Design, develop, and maintain distributed web crawler systems, ensuring efficient data scheduling, scraping, parsing, and storage
Collect and process data from the internet and partner sources in compliance with website policies and legal regulations
Optimize crawler performance to handle large-scale data extraction with high efficiency and reliability
Solve complex technical challenges related to web crawling, including anti-crawling mechanisms, dynamic content rendering, and data quality assurance
Collaborate with cross-functional teams, including data scientists, backend engineers, and product managers, to meet diverse business data requirements
Stay updated with the latest web technologies and crawling frameworks to continuously improve system capabilities
Qualification
Required
Bachelor's degree or higher in Computer Science, Engineering, or a related field, with at least 2 years of experience in web crawling and data collection
Proficiency in mainstream web scraping technologies and frameworks/tools such as Scrapy, Selenium, and Puppeteer
Strong coding skills in at least one programming language, such as Python, Java, Go, or C++
Solid understanding of web technologies, including HTML, CSS, JavaScript, and web protocols (HTTP/HTTPS)
Strong problem-solving skills, attention to detail, and the ability to work independently or as part of a team
Preferred
Experience with distributed systems, data pipelines, and storage solutions is a plus
Familiarity with frontend development and dynamic content rendering techniques is preferred
Benefits
Health, dental, and vision care for you and your family (100% coverage for employee)
Top-tier 401(K) plan with company matching
Paid time off and paid holidays
FSA, HSA and commuter benefits programs
Team activity budget
Company
NewsBreak
NewsBreak is the leading platform that connects people with the information that truly matters, through technology
H1B Sponsorship
NewsBreak has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (28)
2024 (6)
2023 (7)
2022 (10)
2021 (18)
2020 (12)
Funding
Current Stage
Growth StageTotal Funding
$147.6MKey Investors
Francisco Partners
2021-01-07Series C· $115M
2019-09-26Series B· $11M
2017-05-11Series B· $7.6M
Recent News
Company data provided by crunchbase