TransPerfect · 15 hours ago
Python Developers - US
DataForce by TransPerfect is looking for skilled Python Developers to architect, build, and own the data pipelines that power large language model (LLM) development. Your primary mission will be to build scalable, automated systems that transform massive raw datasets into clean, model-ready formats.
Language LearningService IndustryTranslation Service
Responsibilities
Design, develop, and own robust, scalable, and automated ETL/ELT pipelines in Python to ingest and process terabyte-scale text datasets
Implement rigorous data cleaning, deduplication, filtering, and normalization strategies, and define and enforce data quality standards to ensure high integrity for model training
Efficiently structure and format diverse datasets (e.g., JSON, Parquet) for consumption by LLM training frameworks
Work closely with AI researchers and ML engineers to understand data requirements, define metrics, and support the model training lifecycle
Continuously optimize data processing workflows for performance, cost efficiency, and reliability
Occasionally assist with launching, monitoring, and debugging data-related issues during model training runs
Qualification
Required
5–10 years of professional experience in Python development, data engineering, data processing, or backend software engineering
Expert-level proficiency in Python and its data ecosystem (e.g., Pandas, NumPy, Dask, Polars)
Proven experience building and maintaining large-scale data pipelines
Deep understanding of data structures, data modeling, and software engineering best practices (Git, CI/CD, testing)
Experience handling and parsing diverse data formats (JSON, CSV, XML, Parquet) at scale
Excellent problem-solving skills and a meticulous attention to detail
Strong communication and collaboration skills, with experience working in a team environment
Preferred
Hands-on experience with the data preprocessing pipeline for an LLM (e.g., LLaMA, BERT, GPT-family)
Experience with big data frameworks like Apache Spark or Ray
Experience with Hugging Face libraries (Transformers, Datasets, Tokenizers)
Familiarity with ML frameworks like PyTorch or TensorFlow
Proficiency with cloud platforms (AWS, GCP, Azure) and their data/storage services
Company
TransPerfect
TransPerfect is a language services company offering multilingual translation and interpreting solutions to multinational businesses.
H1B Sponsorship
TransPerfect has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (3)
2024 (2)
2021 (4)
2020 (3)
Funding
Current Stage
Late StageTotal Funding
$875M2025-04-10Debt Financing· $425M
2019-06-20Debt Financing· $450M
Recent News
Morningstar.com
2026-01-09
2026-01-07
GlobeNewswire
2026-01-06
Company data provided by crunchbase