Resource Logistics Inc. ยท 5 hours ago
ADF Engineer
Raleigh, NC
Full-time
Onsite
Senior LevelResource Logistics Inc. is seeking an ADF Engineer to work in Raleigh, NC. The role involves designing and implementing data processing pipelines, optimizing SQL, and utilizing various Clienture services to manage and secure data.
Information TechnologySoftware
Responsibilities
Expert level skills writing and optimizing complex SQL
Experience with complex data modelling, ETL design, and using large databases in a business environment
Experience with building data pipelines and applications to stream and process datasets at low latencies
Fluent with Big Data technologies like Spark, Kafka and Hive
Expert level understanding on Clienture Data Factory, Clienture Synapse, Clienture SQL, Clienture Data Lake, and Clienture App Service is required
Designing and building of data pipelines using API ingestion and Streaming ingestion methods
Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code is essential
Experience in developing NO SQL solutions using Clienture Cosmos DB is essential
Working knowledge of Python is desirable
Designing and implementing scalable and secure data processing pipelines using Clienture Data Factory, Clienture Databricks, and other Clienture services
Managing and optimizing data storage using Clienture Data Lake Storage, Clienture SQL Data Warehouse, and Clienture Cosmos DB
Implementing data security measures, including encryption, access controls, and auditing, to protect sensitive information
Automating data pipelines and workflows to streamline data ingestion, processing, and distribution tasks
Utilizing Clienture's analytics services, such as Clienture Synapse Analytics, to provide insights and support data-driven decision-making
Qualification
Required
Expert level skills writing and optimizing complex SQL
Experience with complex data modelling, ETL design, and using large databases in a business environment
Experience with building data pipelines and applications to stream and process datasets at low latencies
Fluent with Big Data technologies like Spark, Kafka and Hive
Expert level understanding on Clienture Data Factory, Clienture Synapse, Clienture SQL, Clienture Data Lake, and Clienture App Service is required
Designing and building of data pipelines using API ingestion and Streaming ingestion methods
Knowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code is essential
Experience in developing NO SQL solutions using Clienture Cosmos DB is essential
Designing and implementing scalable and secure data processing pipelines using Clienture Data Factory, Clienture Databricks, and other Clienture services
Managing and optimizing data storage using Clienture Data Lake Storage, Clienture SQL Data Warehouse, and Clienture Cosmos DB
Implementing data security measures, including encryption, access controls, and auditing, to protect sensitive information
Automating data pipelines and workflows to streamline data ingestion, processing, and distribution tasks
Utilizing Clienture's analytics services, such as Clienture Synapse Analytics, to provide insights and support data-driven decision-making
Preferred
Working knowledge of Python
Company
Resource Logistics Inc.
Resource Logistics is an information technology company providing ERP, CRM implementation, software solutions, and staffing services.
Founded in 1997
1001-5000 employees
H1B Sponsorship
Resource Logistics Inc. has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (14)
2024 (19)
2023 (10)
2022 (29)
2021 (35)
2020 (39)
Funding
Current Stage
Late StageCompany data provided by crunchbase