micro1 · 17 hours ago

Data Engineer

United States

Full-time

Remote

Mid Level

$15,000/mo - $20,000/mo

Maximize your interview chances

Artificial Intelligence (AI)Consulting

Actively Hiring

Hiring Manager

Melina Chervone

Insider Connection @micro1

Discover valuable connections within the company who might provide insights and potential referrals.
Get 3x more responses when you reach out via email instead of LinkedIn.

Responsibilities

Design and implement data pipelines to efficiently process and manage large datasets.

Develop robust and scalable data storage solutions using databases and data lakes.

Collaborate with stakeholders to understand data requirements and optimize data architecture.

Utilize distributed computing frameworks like Apache Spark or Dask to handle large data processing tasks.

Ensure data quality and governance by implementing best practices in data management.

Conduct data preprocessing and transformation for machine learning model readiness.

Leverage cloud platforms like AWS, GCP, or Azure for data processing and storage.

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

PythonSQLDistributed ComputingData ArchitectureCloud PlatformsData GovernanceETL ToolsHadoopKafkaApache FlinkAirflowMachine Learning Principles