Lumen Solutions Group Inc. ยท 2 days ago
Lead Big Data administrator
Maximize your interview chances
IT Services and IT Consulting
Growth Opportunities
Insider Connection @Lumen Solutions Group Inc.
Get 3x more responses when you reach out via email instead of LinkedIn.
Responsibilities
The Lead Data Engineer is responsible for orchestrating, deploying, maintaining and scaling cloud infrastructure targeting big data and platform data management (e.g., data warehouses, data lakes) including data access APIs.
Prepares and manipulates data using Hadoop or equivalent.) with emphasis on high availability, reliability, automation and performance.
This role will focus on leading the automation and components (Solr, HBase) set up and improvement for Cloudera CDP public cloud and integrate with other AWS services.
Advanced (expert preferred) level experience in administrating and engineering relational databases (ex. MySQL, PostgreSQL), Big Data systems (ex. Cloudera Data Platform Private Cloud and Public Cloud), Apache Solr as SME, automation tools (ex. Ansible, Terraform, Bit Bucket) and experience working cloud solutions (specifically data products on AWS) are necessary.
At least 10 years of Experienced with all the tasks involved in administration of big data and Meta Data Hub such as Cloudera.
Cloudera Solr and HBase experience is a MUST.
Experience with Ab Initio, EMR, S3, Dynamo DB, Mongo DB, ProgreSQL, RDS, DB2 is a Plus.
DevOps (CI/CD Pipeline) is a Plus.
Experience with Advance knowledge of UNIX and SQL
Experience with manage metadata hub-MDH, Operational Console and troubleshoot environmental issues which affect these components.
Represents team in all architectural and design discussions.
Knowledgeable in the end-to-end process and able to act as an SME providing credible feedback and input in all impacted areas.
Require tracking and monitoring projects and tasks as the lead as well as taking on hands on work.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
Hands-on experience in setting up Cloudera Solr and HBase.
Experience leading a Cloudera Admin team.
Responsible for orchestrating, deploying, maintaining and scaling cloud infrastructure targeting big data and platform data management.
Prepares and manipulates data using Hadoop or equivalent with emphasis on high availability, reliability, automation and performance.
Focus on leading the automation and components (Solr, HBase) set up and improvement for Cloudera CDP public cloud.
Advanced (expert preferred) level experience in administrating and engineering relational databases (ex. MySQL, PostgreSQL).
Experience with Big Data systems (ex. Cloudera Data Platform Private Cloud and Public Cloud).
Experience as SME in Apache Solr.
Experience with automation tools (ex. Ansible, Terraform, Bit Bucket).
Experience working with cloud solutions (specifically data products on AWS).
At least 10 years of experience with all tasks involved in administration of big data and Meta Data Hub such as Cloudera.
Cloudera Solr and HBase experience is a MUST.
Experience with advanced knowledge of UNIX and SQL.
Experience managing metadata hub-MDH, Operational Console and troubleshooting environmental issues.
Preferred
Experience with Ab Initio, EMR, S3, Dynamo DB, Mongo DB, ProgreSQL, RDS, DB2.
DevOps (CI/CD Pipeline) experience.