KPI Partners · 1 day ago
Lead Data Engineer
United States
Full-time
Remote
Senior Level
$145K/yr - $160K/yr
5+ years exp
Maximize your interview chancesConsultingInformation Technology
No H1B
U.S. Citizen OnlyHiring Manager
Sid Goel
Insider Connection @KPI Partners
Get 3x more responses when you reach out via email instead of LinkedIn.
Responsibilities
Lead the design, development, and implementation of data pipelines and solutions using PySpark, SQL, and related technologies.
Work closely with cross-functional teams to understand business requirements and translate them into robust data solutions.
Design and implement data warehousing solutions, ensuring scalability, performance, and reliability.
Stay up to date with modern technologies and trends in data engineering and apply them to improve our data platform.
Provide guidance and mentorship to junior data engineers, ensuring best practices in coding, design, and development.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
5+ years of experience in data engineering, with a strong background in building large-scale data solutions.
3+ years of hands-on experience developing and implementing data pipelines using PySpark, Azure Data Factory and Databricks.
Proven expertise in SQL for querying, manipulating, and analyzing large datasets.
Strong knowledge of ETL processes and data warehousing fundamentals.
Self-motivated and independent, with a 'let’s get this done' mindset and the ability to thrive in a fast-paced and dynamic environment.
Preferred
Databricks Certification is a plus.
Experience with Azure-native services such as ADLS, Synapse/DW, Azure SQL DB, and Microsoft Fabric.
Familiarity with Event Hub, IoT Hub, Azure Stream Analytics, Azure Analysis Service, and Cosmos DB.
Knowledge of SAP Hana.
Familiarity with DevOps practices and CI/CD deployment pipelines.
Benefits
Paid Holidays
Paid PTO
Full Health Benefits including Health, Dental, Vision, Life, LTD, STD, FSA, HSA, and 401K
Company
KPI Partners
KPI Partners provides strategic guidance and technology systems for clients wishing.
501-1,000 employees
Funding
Current Stage
Late StageLeadership Team
Kusal Swarnakar
Co-founder & Partner
Sid Goel
Partner and CTO
Recent News
Analytics India Magazine
2024-02-16
Company data provided by crunchbase
