Be an early applicantLess than 25 applicants

Company

Hope Enterprise Corporation · 4 hours ago

Data Engineer - Remote only in MS, LA, AR, AL, and TN

Jackson, MS

Full-time

Remote

Mid, Senior Level

6+ years exp

Maximize your interview chances

Non-profit Organization Management

Insider Connection @Hope Enterprise Corporation

Discover valuable connections within the company who might provide insights and potential referrals.
Get 3x more responses when you reach out via email instead of LinkedIn.

Responsibilities

Integrate data from various sources, ensuring data consistency, quality, and reliability.

Design, build, and maintain scalable data pipelines to support data warehousing, analytics, and reporting needs.

Support with Data preparation and feature engineering for models.

Optimize data processing and retrieval performance, ensuring efficient handling of large datasets.

Leverage Spark and Databricks for data processing and analytics.

Utilize Azure Purview to ensure adherence to data governance policies and procedures, maintaining data quality and security standards.

Develop and maintain Data Quality Assurance standards, pipelines, and reports for data in our environment

Work closely with data scientists, analysts, and IT teams to understand data requirements and deliver effective data solutions.

Provide technical support for data-related issues and troubleshoot problems as they arise.

Maintain comprehensive documentation of data processes, architectures, and workflows.

Stay current with industry trends and best practices, recommending improvements to existing processes and technologies.

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

Data Pipeline DevelopmentSQLAzure Data Engineering ToolsSparkDatabricksData Quality AssuranceData IntegrationData PreparationData Visualization ToolsPythonRJavaScalaGCP ToolsData ModelingOrganizational AwarenessResults OrientationProject Management

Required

Bachelor’s degree (or higher) in Computer Science, Engineering, or a related discipline.

6+ years of experience in data engineering or a related field

Travel up to 25%

Preferred

Technical Proficiency: Strong proficiency in SQL and experience with Python, R, Java, or Scala is required.

Azure Tools: Experience with the Azure Data Engineering tools including; Azure Synapse, Azure Data Factory (ADF), and Azure Data Lake Storage (ADLS) Gen 2 and Purview is required.

Spark and Databricks: Experience with Spark/PySpark/SparkR and Databricks for data processing and analytics is required.

Company

Hope Enterprise Corporation

HOPE is a family of development organizations dedicated to strengthening communities, building assets and improving lives in the Delta and other economically distressed parts of Arkansas, Louisiana, Mississippi and Tennessee.

Founded in 1994

Jackson, MS, US

51-200 employees