Blu Omega · 8 hours ago
Senior Data Engineer
Blu Omega is looking for a Senior Data Engineer to design a cloud-based data solution to support the healthcare data repository for one of their clients. The role involves leading the planning, designing, and deployment of hybrid on-premises and cloud architecture solutions to enable data science and advanced analytics applications.
Responsibilities
Recommend standards, tools, and capabilities based on your research of the environment and knowledge
Explore how to help customers overcome their most difficult challenges in cloud data storage
Work with the client’s technical leads to implement strategy and architecture design
Lead the planning, designing, and deployment of hybrid on-premises and cloud architecture solutions for use in a next-gen platform enabling data science and advanced analytics applications leveraging artificial intelligence and machine learning, automation, cloud-based security, and big data
Focus on growing as a team to make the best solutions for our customers, so you’ll have resources for mentoring and learning new skills and tools
Join our team as we transform the healthcare capabilities with cloud technology
Qualification
Required
10+ years of experience with IT
Experience in programming languages such as Python, Scala, or Java
Experience with data validation, cleansing, and enrichment techniques to improve the accuracy and completeness of data
Experience with building and optimizing data pipelines to extract data from various sources, transform it into the required format, and load using Databricks and AWS services
Experience with monitoring and troubleshooting ETL processes to identify and resolve issues in a timely manner
Experience in designing and developing ETL workflows using tools such as Apache Spark or AWS Glue
Experience with different data storage technologies and databases, such as Amazon S3 or Amazon Redshift
Knowledge of ETL best practices, data integration techniques, and data quality management
Experience with multiple operating systems and languages and planning and implementing large-sized databases
Knowledge of Cloud database technology, cloud-native data architecture
Experience with CMS (Centers for Medicare & Medicaid Services) programs
Ability to obtain and maintain a Public Trust
Bachelor's degree
Preferred
Experience with UNIX/Linux, including basic commands and Shell scripting
Experience with a public cloud, including AWS, Microsoft Azure, or Google Cloud
Experience with distributed data and computing tools including Spark, Databricks, Hadoop, Hive, AWS EMR, or Kafka
Experience working on real-time data and streaming applications
Experience with NoSQL implementation, including MongoDB or Cassandra
Experience with data warehousing using AWS Redshift, MySQL, or Snowflake
Experience with Agile engineering practices
Knowledge of concepts of Data Lakehouse architecture