Twine · 5 hours ago
Senior Engineer - Freelance
United States
Contract
Remote
Senior Level, Lead/Staff
10+ years exp
Maximize your interview chancesAnimationContent Creators
No H1B
Insider Connection @Twine
Get 3x more responses when you reach out via email instead of LinkedIn.
Responsibilities
Lead a team of data engineers in designing, building, and maintaining a high-performance software system to manage analytical data pipelines.
Work closely with stakeholders across the business to understand their data needs, ensure scalability, and foster a culture of innovation and learning within the data engineering team and beyond.
Be responsible for the overall architecture of specific modules within a product, perform design, assist implementation considering system characteristics to produce optimal performance, reliability, and maintainability.
Provide technical guidance to team members, create and manage technical documentation, and lead efforts in architecting, designing, and building scalable data pipelines for processing large volumes of structured and unstructured data.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
Authorization to work in the USA without requiring sponsorship
10+ years of related experience in developing data solutions and data movement
Bachelor's or Master's in Computer Science, Information Systems, or an engineering field or relevant experience
AWS experience with a focus on implementing and optimizing data pipelines
Extensive hands-on data system design and coding experience
Experience with modern data pipelines (AWS Step Functions, Prefect, Airflow, Luigi, Python, Spark, SQL)
Production delivery experience in Cloud-based PaaS Big Data technologies (EMR, Snowflake, Databricks, etc.)
Strong programming experience in PySpark, SQL, Python, and proficiency in at least one programming language (C#, GoLang, JavaScript, or ReactJs)
Experience with distributed file systems (S3, HDFS, ADLS) and various open file formats (JSON, Parquet, CSV, etc.)
Database design skills including normalization/de-normalization and data warehouse design
Company
Twine
Twine is a platform that helps companies hire freelancers.
2-10 employees
Funding
Current Stage
Early StageTotal Funding
$2.63MKey Investors
GC AngelsEASME - EU Executive Agency for SMEs
2020-08-13Series Unknown· $1.57M
2017-07-17Seed
2017-04-12Seed· $0.5M
Leadership Team
Joe Scarffe
CMO
Recent News
2024-11-15
2023-03-02
Company data provided by crunchbase
