KRG Technologies Inc. ยท 9 hours ago
Lead Data Engineer _ Remote - Fulltime role
Maximize your interview chances
Insider Connection @KRG Technologies Inc.
Get 3x more responses when you reach out via email instead of LinkedIn.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
BS or MS in Computer Science (or related field) with 12 - 15 years of hands-on software development experience working in large-scale data processing pipelines
Must have skills are Apache Spark 3.x and Scala with 4-5 years of experience building production grade batch pipelines that handle large volumes of data
8+ years of experience in Java and API / Microservices
8+ years of experience in understanding and writing complex SQL and stored procedures for processing raw data, ETL, data validation, using databases such as SQL Server, Redis and other NoSQL DBs
Knowledge of Big data technologies, Hadoop, HDFS
Expertise with building spark streaming pipelines with Kafka
Expertise with Amazon AWS stack such as EMR, EC2, S3
Experience working with APIs to collect and ingest data as well build the APIs for business logic
Experience working with setting up, maintaining, and debugging production systems and infrastructure
Experience in building fault-tolerant and resilient system
Experience in building worker nodes, knowledge of REST principles and data engineering design patterns
In-depth knowledge of Spark, Scala, Java, Orchestration tools, ESB, SQL, Stored procedures, Docker, RESTful web services, Kubernetes, CI/CD, Observability techniques, Kafka, Release processes, caching strategies, versioning, B&D, Bitbucket / Git and AWS Cloud Ecosystem
Strong software development, architecture diagramming, problem-solving and debugging skills
Phenomenal communication and influencing skills
Company
KRG Technologies Inc.
KRG Technologies is an information technology company offering business process re-engineering services.
H1B Sponsorship
KRG Technologies Inc. has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (20)
2022 (10)
2021 (26)
2020 (12)
Funding
Current Stage
Late StageLeadership Team
Company data provided by crunchbase