122 applicants

This job has closed.

Company

Original Job Post

Cigars International · 4 days ago

Data Engineer

Bethlehem, PA

Full-time

Onsite

Mid Level

2+ years exp

Wonder how qualified you are to the job?

Maximize your interview chances

Direct MarketingTobacco

Insider Connection @Cigars International

Discover valuable connections within the company who might provide insights and potential referrals, giving your job application an inside edge.

Responsibilities

Implement data integration projects, including developing a data model, maintaining a data warehouse and analytics environment, and writing scripts for data integration and analysis.

Build and maintain optimized and highly available data pipelines that facilitate deeper analysis and reporting by the Data and Analytics department.

Analyze, transform, and prepare data for large scale migration projects.

Identify and work on master data consolidation and management as part of data migration.

Develop automated workflows to perform data migrations using both on-premises and cloud-based technologies.

Create complex stored procedures, views, materialized views, functions, and other database objects using TSQL as required.

Design, implement, test, deploy, and maintain stable, secure, and scalable data engineering solutions and pipelines in support of data and analytics projects.

Produce scalable, replicable code and solutions that help automate repetitive data management tasks.

Perform one-off data manipulation and analysis.

Implement and monitor best in class security measures in the data warehouse and analytics environment.

Design robust integration solution error handling, monitoring, and reporting.

Perform in-depth data analysis to validate system behavior, identify problems, and support business users.

Collaborate with application and IT system administration teams as required and make recommendations on SQL Server sizing and configuration, database design and features, or T-SQL query tuning/best practices.

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

PythonData manipulationData analysisAutomated processesMs sql serverStored proceduresEtl pipelinesRelational databasesDatabase modelingSystems designData managementData warehouseBig data systemsSql queriesDebuggingData migrationT-sqlSql server management studioJsonXmlAzure data bricksAzure data factoryPowershellRelease managementGitVisual studioMicrosoft azureData mappingData typesProblem-solving

Required

Bachelor’s degree in computer science, computer engineering, or similar technical discipline or equivalent work experience.

Intermediate+ proficiency with Python, especially for data manipulation and analysis, and ability to build, maintain and deploy sequences of automated processes.

2+ years of experience on MS SQL Server, writing complex stored procedures and functions and working on ETL pipelines.

Advanced level knowledge of relational databases, database structures and modeling, systems design, data management, data warehouse a plus.

Proven experience working hands-on with big data systems.

Extensive experience on writing complex SQL Queries to analyze and transform data sets.

Experience in master data management for large scale implementations.

Experience in debugging and identifying gaps in data elements.

Experience in working on data migration projects with large data sets.

High proficiency in Microsoft SQL Server, T-SQL query language, Python Programming Language a must, SQL Server Management Studio (SSMS), JSON and XML.

Azure Data Bricks / Azure Data Factory is a plus.

PowerShell is a plus.

Release management (Git, Visual Studio, etc.) is a plus.

Experience with Microsoft Azure a plus.

Experience with data mapping and various data types.

Excellent communication skills.

Strong logical, analytical, and problem-solving skills.

Can work in a fast-paced, ever-changing environment with a growth mindset.