35 applicants
This job has closed.
Swiftly · 3 days ago
Principal Data Engineer
United States
Full-time
Remote
Senior Level
10+ years exp
Wonder how qualified you are to the job?
Maximize your interview chancesE-CommerceE-Commerce Platforms
Insider Connection @Swiftly
Responsibilities
Design, build, deploy, and maintain ETL (Extract, Transform, Load) processes using Azure hosted technologies
Orchestrate data workflows to integrate structured and unstructured data from multiple sources
Manage customer import and export processes involving Secure File Transfer Protocol (SFTP), Azure Storage, and AWS S3 for data exchange
Ensure data security and compliance during data transfers between systems
Support an inclusive engineering culture and mentor the engineering team
Advocate for Agile development methodologies and participate in the software development lifecycle (SDLC) activities
Implement and maintain security measures to protect company assets and customer data
Develop contingency plans to address potential issues
Collaborate with data scientists, software engineers, and stakeholders to create efficient data pipelines using Databricks
Optimize data processing at scale using Databricks capabilities while managing costs
Author REST servers and client to enhance data and provide admin portal functionality
Develop models and data sets to enhance personalized services for retail grocery shoppers
Leverage data to improve customer experiences through effective targeting
Perform any other related duties as assigned
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
Bachelor’s or Master’s degree in Computer Science, Engineering, Information Systems, or a related field
10+ years of Data Engineering experience
5+ years in a small team, startup environment
Strong knowledge of Python
Foundational understanding of Azure, Eventhubs, storage accounts and infrastructure considerations
Experience with SQL, message queuing, stream processing, and advertising platforms
Deep experience with data pipelines (ETL/ELT, Spark, dbt, Airflow, Databricks, etc.)
Deep experience with OLAP database design, build, run (Star/ Snowflake, Fact / Dim, Snowflake, etc.)
Deep experience with distributed application design, build, run (api, queues, idempotent, encapsulated, etc.)
Experienced with cloud infrastructure (infra as code, cdk, Terraform, Kubernetes, containers & images
Proven experience in a leadership role within engineering, with a track record of successful project delivery
Excellent communication, and interpersonal skills
Preferred
10+ years in a customer facing, B2B or SaaS data engineering
Large corporate experience (in addition to startup experience)
Experience working in a distributed (remote first) environment
Deep experience using Databricks
Experience with Postgres
Deep experience with OLTP database design, build, run (SQL, normalization, query optimization, Databricks, etc.)
Company
Swiftly
Swiftly is an innovative technology platform.
51-200 employees
H1B Sponsorship
Swiftly has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Trends of Total Sponsorships
2022 (3)
Funding
Current Stage
Growth StageTotal Funding
$215.6MKey Investors
BRV Capital ManagementWormhole Capital
2022-09-19Series C· $100M
2022-03-08Series B· $100M
2021-11-10Series B· Undisclosed
Leadership Team
Henry Kim
Co-Founder & CEO
Karen Ho
Co-Founder & Head of Mobile Development
Recent News
wormholecap
2023-08-29
Ruttenberg Gordon Investments
2023-07-28
Company data provided by crunchbase
