Crunchyroll · 20 hours ago

Senior Data Engineer - Platform Engineering

San Francisco Bay Area, CA

Full-time

Remote

Senior Level, Lead/Staff

$167K/yr - $209K/yr

8+ years exp

Maximize your interview chances

Subscription ServiceVideo

Insider Connection @Crunchyroll

Discover valuable connections within the company who might provide insights and potential referrals.
Get 3x more responses when you reach out via email instead of LinkedIn.

Responsibilities

Designing, implementing, and optimizing data services and pipelines.

Collaborating with cross-functional teams to enable operational data analysis.

Enhancing eventing systems and developing tools that empower data and services teams.

Driving 100% automation and best practices in data engineering.

Creating scalable architectures and optimizing data environments.

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

Data EngineeringAWS Cloud PlatformData PipelinesAutomation FrameworksSQLNoSQL DatabasesCI/CD PipelinesPythonJavaDatabricksApache KafkaAWS GlueTerraformCloud FormationSchema DesignQuery TuningMentoring

Required

Bachelor's degree in Computer Science, Information Technology, or a related field.

8+ years of experience in data engineering, with a focus on building and optimizing data pipelines, data architecture, and eventing systems.

Extensive experience with AWS cloud platform and their data-related services.

Proficiency in automation frameworks (e.g., Terraform, Cloud Formation).

Proficiency in data lake and pipeline tools and frameworks (e.g., Databricks, Apache Kafka/Kinesis, AWS Glue).

Proficiency in one or more programming languages (e.g. Python, Java).

Strong understanding of SQL (e.g. Redshift, Snowflake, RDS) and NoSQL databases (e.g., DynamoDB) and experience in enabling analytical queries on these platforms.

Experience with search optimization, including schema design and query tuning.

Experience in building CI/CD pipelines, testing frameworks (e.g. dbt), and best practices in data engineering.

Strong problem-solving skills and a proactive approach to identifying and addressing issues.

Ability to independently own and execute projects while effectively collaborating with the team to influence and shape the vision of the data engineering organization.

Strong communication skills and the ability to mentor and guide junior engineers.