Senior Software Engineer, Web jobs in United States
cer-icon
Apply on Employer Site
company-logo

NewsBreak · 2 weeks ago

Senior Software Engineer, Web

NewsBreak is a Content Intelligence platform shaping the future content economy, boasting over 40 million monthly active users. The role involves building and optimizing data acquisition infrastructure, focusing on web crawling and data processing to support critical business needs.

Advertising PlatformsArtificial Intelligence (AI)Content CreatorsSearch Engine
check
H1B Sponsor Likelynote

Responsibilities

Design, develop, and maintain distributed web crawler systems, ensuring efficient data scheduling, scraping, parsing, and storage
Collect and process data from the internet and partner sources in compliance with website policies and legal regulations
Optimize crawler performance to handle large-scale data extraction with high efficiency and reliability
Solve complex technical challenges related to web crawling, including anti-crawling mechanisms, dynamic content rendering, and data quality assurance
Collaborate with cross-functional teams, including data scientists, backend engineers, and product managers, to meet diverse business data requirements
Stay updated with the latest web technologies and crawling frameworks to continuously improve system capabilities

Qualification

Web scraping technologiesDistributed systemsData pipelinesPythonJavaGoC++HTMLCSSJavaScriptFrontend developmentProblem-solving skillsAttention to detailTeamwork

Required

Bachelor's degree or higher in Computer Science, Engineering, or a related field, with at least 2 years of experience in web crawling and data collection
Proficiency in mainstream web scraping technologies and frameworks/tools such as Scrapy, Selenium, and Puppeteer
Strong coding skills in at least one programming language, such as Python, Java, Go, or C++
Solid understanding of web technologies, including HTML, CSS, JavaScript, and web protocols (HTTP/HTTPS)
Strong problem-solving skills, attention to detail, and the ability to work independently or as part of a team

Preferred

Experience with distributed systems, data pipelines, and storage solutions is a plus
Familiarity with frontend development and dynamic content rendering techniques is preferred

Benefits

Health, dental, and vision care for you and your family (100% coverage for employee)
Top-tier 401(K) plan with company matching
Paid time off and paid holidays
FSA, HSA and commuter benefits programs
Team activity budget

Company

NewsBreak

twittertwitter
company-logo
NewsBreak is the leading platform that connects people with the information that truly matters, through technology

H1B Sponsorship

NewsBreak has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (28)
2024 (6)
2023 (7)
2022 (10)
2021 (18)
2020 (12)

Funding

Current Stage
Growth Stage
Total Funding
$147.6M
Key Investors
Francisco Partners
2021-01-07Series C· $115M
2019-09-26Series B· $11M
2017-05-11Series B· $7.6M

Leadership Team

leader-logo
Jeff Zheng
Founder & CEO — we are hiring!
linkedin
leader-logo
Corey Frankel
Strategic Partner Manager
linkedin
Company data provided by crunchbase