Scalence L.L.C. · 2 weeks ago
Big Data Engineer
Chicago, IL
Full-time
Onsite
Mid LevelScalence L.L.C. is a supportive community dedicated to delivering exceptional customer experiences. They are seeking a Big Data Engineer to design, develop, and maintain data pipelines and architecture while collaborating with cross-functional teams to optimize system performance and data integrity.
Information Technology & Services
No H1B
Responsibilities
Design, develop, and maintain data pipelines and architecture
Collaborate with cross-functional teams to meet project goals
Monitor and optimize system performance and data integrity
Qualification
Required
Applicants must be able to work directly for our company on W2
Strong SQL Skills – one or more of MySQL, HIVE, Impala, SPARK SQL
Data ingestion experience from message queue, file share, REST API, relational database, etc., and experience with data formats like JSON, CSV, XML
Experience working with SPARK Structured Streaming
Experience working with Hadoop/Big Data and Distributed Systems
Working experience with Spark, Sqoop, Kafka, MapReduce, NoSQL Database like HBase, SOLR, CDP or HDP, Cloudera or Hortonworks, Elastic Search, Kibana, etc
Hands-on programming experience in at least one of Scala, Python, PHP, or Shell Scripting
Performance tuning experience with Spark/MapReduce or SQL jobs
Experience and proficiency with Linux operating system is a must
Experience in end-to-end design and build process of Near-Real Time and Batch Data Pipelines
Experience working in Agile development process and deep understanding of various phases of the Software Development Life Cycle
Experience using Source Code and Version Control systems like SVN, Git, BitBucket, etc
Experience working with Jenkins and Jar management
Self-starter who works with minimal supervision and the ability to work in a team of diverse skill sets
Ability to comprehend customer requests and provide the correct solution
Strong analytical mind to help tackle complicated problems
Desire to resolve issues and dive into potential issues
Ability to adapt and continue to learn new technologies is important
Preferred
Experience in additional programming languages or technologies
Experience with cloud platforms
Advanced data analytics skills
Benefits
Inclusive and diverse work environment
Opportunities for professional growth and development
Comprehensive benefits package
Company
Scalence L.L.C.
In today’s dynamic and competitive market, success hinges on mastering three key areas: Data Intelligence, Business Resilience, and Digital Experience.
501-1000 employees
Funding
Current Stage
Late StageCompany data provided by crunchbase