E Source · 6 days ago
Data Engineer IV - REMOTE
United States
Full-time
Remote
Mid, Senior Level
$120K/yr - $145K/yr
7+ years expE Source is a leading provider of software solutions and consulting services for utilities and their customers. They are seeking a senior data engineer to design and build scalable, reliable, and secure data pipelines and infrastructure for their consulting services and SaaS solutions.
EnergyEnergy EfficiencyInformation Services
No H1B
Responsibilities
Design, develop, and maintain data pipelines, infrastructure, and systems to support data products and solutions using technologies such as AWS, Python, Databricks, Spark, and SQL databases like PostgreSQL
Work with cross-functional teams to translate business problems into technical solutions and provide technical guidance and mentorship to junior data engineers
Create and maintain optimal data pipeline architecture
Assemble and process large, complex data sets that meet functional/non-functional business requirements
Identify, design and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability
Implement processes and systems to monitor data quality, ensuring production data is always available for key stakeholders
Design data integrations and data quality frameworks
Develop and implement data engineering strategies and best practices that align with business objectives and customer needs
Monitor and troubleshoot data pipelines and systems to ensure data quality, integrity, and availability
Conduct research on industry trends and best practices to improve data engineering capabilities and evaluate new data technologies and tools
Manage the software development life cycle and DevOps aspects of the code
Collaborate with data scientists and analysts to understand their data requirements and provide them with optimal data solutions
Create new data validation methods and data analysis tools
Qualification
Required
Bachelor's degree in computer science, information technology, or a related field
A minimum of seven years of experience in data engineering or a similar role
Expert-level skills in Python, SQL databases such as PostgreSQL, and big data technologies such as Databricks and Spark
Hands-on experience building cloud resident data pipelines in AWS
Expert of data warehousing and data lake design, development and sustainment
Strong understanding of data governance, security, privacy, and retention policies and procedures
Strong communication, collaboration, and problem-solving skills
Experience with mentoring junior data engineers is an asset
High proficiency using agile software tools like Jira and following mature DevOps practices using GIT, Docker, and CI servers like Jenkins
Passion for data and innovation
Strong knowledge of data modeling, data architecture and data structures
Expert understanding with Agile and DevOps, including CI/CD technologies and practices
Preferred
Demonstrated capacity to work autonomously and proactively, with a proven track record of achieving results without constant supervision
Experience with ETL optimization, designing, coding, and tuning big data processes in Databricks
Sound knowledge of data lineage and data quality techniques
Experience in working with data science and machine-learning models and frameworks
Previous experience in the energy or utility industry in an analytic role
Master's degree in management information systems, computer programming, software engineering, data science, or an equivalent STEM field
Benefits
Excellent insurance packages, including medical, dental, and vision plans
Company-paid life insurance
Company-paid long- and short-term disability insurance
Medical and dependent-care flexible spending plans
Flexible time off (FTO) program
Flexible schedules
Flexible work locations
Paid parental leave benefit
401(k)/RRSP plan with a 3% employer match
Company
E Source
E Source provides independent research, advisory, and information services to utilities, major energy users, and other key players in the
201-500 employees
Funding
Current Stage
Growth StageTotal Funding
unknown2019-06-24Acquired
Leadership Team
Adam Stotz, PhD
Chief Technology Officer
Norv Clontz
Vice President, Data Strategy & Innovation
Recent News
Company data provided by crunchbase