Lumen Solutions Group Inc. ยท 6 days ago
AB Initio Developer
Lumen Solutions Group Inc. is seeking a Senior Data Engineer to orchestrate, deploy, maintain, and scale cloud or on-premises infrastructure targeting big data. The role focuses on developing solutions that transform the company's platforms to deliver data-driven insights and value.
Information Technology & Services
Responsibilities
Work with Business Analysts and Product team to gather data requirements
Design and Build AbInitio data graphs and data pipelines to extract the data various databases/flat files/message queues
Transform the data to create a consumable data layer for various application uses
Support Data pipeline with bug fixes, and additional enhancements
Document Technical design , Operational Runbook etc
Qualification
Required
Bachelor's Degree in Computer Science, Information Technology or Engineering or related field
Total of 10+ Years of IT Experience predominantly in Data Integration/ Data Warehouse area
Must have at least 5 years of ETL Design and Development experience using Ab Initio
1-2 years of Data Integration project experience on Hadoop Platform, preferably Cloudera
Sound understanding of SQL and ability to write well performing SQL queries
Good knowledge of OLTP and OLAP data models and other data warehouse fundamentals
Rigor in high code quality, automated testing, and other engineering best practices, ability to write reusable code components
Ability to unit test the code thoroughly and to troubleshoot issues in production environments
Must have some working experience with Unix/Linux shell scripting
Must be able to work independently and support other junior developers as needed
Knowledge of Agile Development practices
Preferred
ABinitio CDC ( Change Data Capture ) experience in a Data Integration/ETL project setting is great to have
Working knowledge of HDFS, Hive, Impala, and other related Hadoop technologies
Working knowledge in various AWS services is nice to have
Some Java development experience is nice to have