Web Scraping Data Engineer jobs in United States
cer-icon
Apply on Employer Site
company-logo

Verition Fund Management LLC · 1 day ago

Web Scraping Data Engineer

Verition Fund Management LLC is a multi-strategy hedge fund focusing on global investment strategies. They are seeking a Data Engineer with experience in Web Scraping technologies to help establish a new process for their data team, enabling scalable scraping capabilities and interacting with various internal teams.

Business DevelopmentFinanceFinancial Services

Responsibilities

Utilize AI Models, Code, Libraries or applications to enable a scalable Web Scraping capability
Web Scraping Request Management including intake, assessment, accessing sites to scrape, utilizing tools to scrape, storage of scrape, validation and entitlement to users
Fielding Questions from users about the scrapes and websites
Coordinating with Compliance on approvals and TOU reviews
Some Experience building Data pipelines in AWS platform utilizing existing tools like Cron, Glue, Eventbridge, Python based ETL, AWS Redshift
Normalizing/standardizing vendor data, firm data for firm consumption
Implement data quality checks to ensure reliability and accuracy of scraped data
Coordinate with Internal teams on delivery, access, requests, support
Promote Data Engineering best practices

Qualification

Web Scraping frameworksAWS cloud experiencePython programmingNoSQL databasesSQL databasesData pipeline orchestrationCapital markets experienceDev OpsCommunication skillsWork independently

Required

Bachelor's degree in computer science, Engineering, Mathematics or related field
2-5 experience in a similar role
Capital markets experience is necessary with good working knowledge of reference data across asset classes and experience with trading systems
AWS cloud experience with commons services (S3, lambda, cron, Event Bridge etc.)
Experience with web-scraping frameworks (Scrapy, BeautifulSoup, Selenium, Playwright etc.)
Strong hands-on skills with NoSQL and SQL databases, programming in Python, data pipeline orchestration tools and analytics tools
Strong communication skills to work with stakeholders across technology, investment, and operations teams
Ability to work independently or as a part of a team in a fast-paced environment with tight deadlines

Preferred

Prior buy side experience is strongly preferred (Multi-Strat/Hedge Funds)
Familiarity with time series data and common market data sources (Bloomberg, Refinitiv etc.) is a plus
Familiarity with modern Dev Ops practices and infrastructure-as-code tools (e.g. Terraform, CloudFormation)

Company

Verition Fund Management LLC

twittertwitter
company-logo
Verition Fund Management LLC (“Verition”) is a multi-strategy, multi-manager hedge fund founded in 2008.

Funding

Current Stage
Late Stage
Total Funding
unknown
Key Investors
Affiliated Managers Group
2025-04-21Private Equity

Leadership Team

leader-logo
Srinivasa Chinnam
Chief Technology Officer
linkedin
leader-logo
Pierre Weinstein
Head of Special Situations Group
linkedin

Recent News

Business Wire
Company data provided by crunchbase