Data Based Development Systems ยท 1 hour ago
HVR/Databricks Data Engineer
Data Based Development Systems is seeking a HVR/Databricks Data Engineer to support data ingestion, transformation, and distribution to end consumers. The role involves working with the Business Intelligence team to design and implement data solutions, develop ETL processes, and maintain project documentation.
Responsibilities
Must be a US Citizen
Must be able to be onsite 2 days a week!
Perform requirements analysis, design/develop process flow, unit and integration tests, and create/update process documentation
Work with the Business Intelligence team and operational stakeholders to design and implement both the data presentation layer available to the user community, as well as the underlying technical architecture of the data warehousing environment
Develop scalable and reliable data solutions to move data across systems from multiple sources in real time as well as batch modes
Design and develop database objects, tables, stored procedures, views, etc
Independently analyze, solve, and correct issues in real time, providing problem resolution end-to-end
Design and develop ETL Processes that will transform a variety of raw data, flat files, xl spreadsheets into SQL Databases
Understand the concept of Data marts and Data lakes and experience with migrating legacy systems to data marts/lake
Use additional cloud technologies (e.g., understands concept of Cloud services like Azure SQL server)
Maintain comprehensive project documentation
Aptitude to learn new technologies and the ability to perform continuous research, analysis, and process improvement
Strong interpersonal and communication skills to be able to work in a team environment to include customer and contractor technical, end users, and management team members
Manage multiple projects, responsibilities and competing priorities
Qualification
Required
Must be a US Citizen
Must be able to be onsite 2 days a week
Experience in projects emphasizing data processing and storage
Requirements analysis, design/develop process flow, unit and integration tests, and create/update process documentation
Work with the Business Intelligence team and operational stakeholders to design and implement both the data presentation layer and the underlying technical architecture of the data warehousing environment
Develop scalable and reliable data solutions to move data across systems from multiple sources in real time as well as batch modes
Design and develop database objects, tables, stored procedures, views, etc
Independently analyze, solve, and correct issues in real time, providing problem resolution end-to-end
Design and develop ETL Processes that will transform a variety of raw data, flat files, xl spreadsheets into SQL Databases
Understand the concept of Data marts and Data lakes and experience with migrating legacy systems to data marts/lake
Uses additional cloud technologies (e.g., understands concept of Cloud services like Azure SQL server)
Maintain comprehensive project documentation
Aptitude to learn new technologies and the ability to perform continuous research, analysis, and process improvement
Strong interpersonal and communication skills to be able to work in a team environment
Manage multiple projects, responsibilities and competing priorities
Programming languages, frameworks, and file formats such as: Python, SQL, PLSQL, and VB
Database platforms such as: Oracle, SQL Server, MySQL
Big data concepts and technologies such as Synapse & Databricks
AWS and Azure cloud computing
HVR data replication
Informatica and/or Immuta for Data Governance