WISEcode · 6 hours ago
Sr. Data Engineer
United States
Full-time
Remote
Senior Level
$150K/yr - $175K/yr
7+ years exp
Maximize your interview chancesAnalyticsArtificial Intelligence (AI)
Insider Connection @WISEcode
Get 3x more responses when you reach out via email instead of LinkedIn.
Responsibilities
Collaborate with product teams and business stakeholders to gather data requirements Participate in sprint planning, backlog grooming, and other agile activities to align with project goals and technical specifications.
Work closely with cross-functional teams to understand project dependencies and ensure smooth execution of data engineering deliverables.
Design, develop, and maintain the organization’s data infrastructure, including data platforms, databases, and analytics tools, while ensuring compliance with data governance and security best practices (e.g., GDPR).
Build and maintain scalable data pipelines for data ingestion, transformation, and storage, optimizing performance and reliability.
Implement data engineering solutions to prepare analytics-ready datasets for analysis and reporting.
Build data models to support various consumption patterns, ensuring efficient data access for different use cases.
Build feature engineering pipelines to integrate machine learning algorithms into the data ecosystem. Integrate machine learning models with data pipelines for seamless deployment and scalability.
Implement data quality checks, validation rules, and cleansing processes to ensure accuracy.
Maintain documentation for platform architecture, data models, data engineering processes, and data lineage.
Participate in Data Operations ensuring adherence to SLA and data quality standards.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
7+ years of combined experience in data engineering, data warehousing, and data science.
Bachelor’s degree in Computer Science, Engineering, or equivalent work experience (Master’s degree preferred).
Expertise in data modeling, ETL processes, and data warehousing concepts.
Strong proficiency in programming languages such as Python and Scala.
Experience with big data technologies and frameworks like Hadoop and Spark.
Hands-on experience with any of the major cloud providers (AWS, Google Cloud, Azure).
Proven experience building data lakes using Databricks, Snowflake, or AWS Redshift.
Proficiency in SQL and relational databases such as SQL Server, PostgreSQL, and MySQL.
Experience developing data pipelines with technologies such as Airflow, Dagster, and Kafka.
Solid understanding of data security and privacy regulations.
Strong understanding of software development life cycle best practices, including test-driven development, continuous integration/deployment, and code security scanning.
Excellent problem-solving skills with a strong attention to detail, and the ability to adapt to evolving requirements.
Ability to navigate ambiguity and drive data engineering tasks to success without relying solely on formal authority.
Proven experience supporting data operations and managing SLAs in a production environment.
Outstanding communication and collaboration skills.
Ability to work independently and manage multiple tasks efficiently.
Positive, can-do attitude with a high-intensity work ethic and commitment to success.
Fast learner with the ability and interest to absorb new information, particularly in the nutrition domain.
5+ years of experience in Python.
5+ years of experience in SQL.
5+ years of experience in PySpark.
Implementing data engineering on Databricks.
Hands-on experience with AWS tech stack.
Working on PostgreSQL database.
Developing data pipelines using frameworks such as Airflow/Dagster/Kafka.
Building data models to structure the data to support various consumption patterns of the data (application consumption, analytics consumption etc.).
Participating in agile methodologies for engineering project execution.
Data access management and governance.
Preferred
Master’s degree in Computer Science, Engineering, or equivalent work experience.
Databricks Data Engineering Professional certification is a strong plus.
Benefits
Medical
Dental
Vision
401(k)
Paid Time Off for vacation, illness, and other types of leave.
Company
WISEcode
WISEcode specializes in cutting-edge artificial intelligence and lab testing for precision nutrition data.
11-50 employees
H1B Sponsorship
WISEcode has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (1)
Funding
Current Stage
Early StageLeadership Team
Tolga Erdogus
CTO
Brian McDermott
Chief Brand Officer
Company data provided by crunchbase
