Jobot Consulting · 2 days ago
Consulting Data Engineer - Scala
Wonder how qualified you are to the job?
Maximize your interview chances
Business Consulting and Services
Insider Connection @Jobot Consulting
Responsibilities
Design, develop, and implement ETL processes, database designs, and data models using SQL, Apache Spark, and Medallion Architecture.
Work closely with data scientists and analysts to understand and implement data requirements.
Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity.
Collaborate with stakeholders and project teams to understand business needs and devise possible solutions.
Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.
Develop processes and tools to monitor and analyze data accuracy and performance.
Work with data and analytics experts to strive for greater functionality in our data systems.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
Bachelor's degree in Computer Science, Engineering, or a related field; Master’s degree preferred.
Minimum of 5 years of experience in a Data Engineer role.
Experience with big data tools Hadoop, Spark, Kafka, etc.
Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets.
Strong analytic skills related to working with unstructured datasets.
Proficient in Scala, SQL, ETL, Apache Spark, and Medallion Architecture.
Experience with AWS cloud services EC2, EMR, RDS, Redshift.
Experience with stream-processing systems Storm, Spark-Streaming, etc.
Strong project management and organizational skills.
Excellent written and verbal communication skills.
Ability to work in a fast-paced and agile development environment.
Experience supporting and working with cross-functional teams in a dynamic environment.
Strong understanding of the latest industry trends and technologies.
Preferred
Master’s degree in Computer Science, Engineering, or a related field.
Opportunity to convert to FTE.
Benefits
401k
Company
Jobot Consulting
Jobot is founded on Kindness, Respect + Results.
Funding
Current Stage
Late StageCompany data provided by crunchbase