Consulting Data Engineer - Scala @ Jobot Consulting | Jobright.ai
JOBSarrow
RecommendedLiked
0
Applied
0
Consulting Data Engineer - Scala jobs in Detroit, MI
200+ applicants
company-logo

Jobot Consulting · 2 days ago

Consulting Data Engineer - Scala

Wonder how qualified you are to the job?

ftfMaximize your interview chances
Business Consulting and Services

Insider Connection @Jobot Consulting

Discover valuable connections within the company who might provide insights and potential referrals, giving your job application an inside edge.

Responsibilities

Design, develop, and implement ETL processes, database designs, and data models using SQL, Apache Spark, and Medallion Architecture.
Work closely with data scientists and analysts to understand and implement data requirements.
Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity.
Collaborate with stakeholders and project teams to understand business needs and devise possible solutions.
Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.
Develop processes and tools to monitor and analyze data accuracy and performance.
Work with data and analytics experts to strive for greater functionality in our data systems.

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

Data EngineeringBig Data Tools HadoopBig Data Tools SparkBig Data Tools KafkaRelational SQLNoSQL Databases PostgresNoSQL Databases CassandraBuilding Data PipelinesOptimizing Data ArchitecturesScalaETLApache SparkMedallion ArchitectureAWS Cloud Services EC2AWS Cloud Services EMRAWS Cloud Services RDSAWS Cloud Services RedshiftStream-Processing Systems StormStream-Processing Systems Spark-StreamingProblem-SolvingHard Working Analytic Skills Communication Skills Project Management SkillsOrganizational Skills Work in a Fast-Paced Environment Work in an Agile EnvironmentExperience Working with Cross-Functional Teams

Required

Bachelor's degree in Computer Science, Engineering, or a related field; Master’s degree preferred.
Minimum of 5 years of experience in a Data Engineer role.
Experience with big data tools Hadoop, Spark, Kafka, etc.
Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets.
Strong analytic skills related to working with unstructured datasets.
Proficient in Scala, SQL, ETL, Apache Spark, and Medallion Architecture.
Experience with AWS cloud services EC2, EMR, RDS, Redshift.
Experience with stream-processing systems Storm, Spark-Streaming, etc.
Strong project management and organizational skills.
Excellent written and verbal communication skills.
Ability to work in a fast-paced and agile development environment.
Experience supporting and working with cross-functional teams in a dynamic environment.
Strong understanding of the latest industry trends and technologies.

Preferred

Master’s degree in Computer Science, Engineering, or a related field.
Opportunity to convert to FTE.

Benefits

401k

Company

Jobot Consulting

twitter
company-logo
Jobot is founded on Kindness, Respect + Results.

Funding

Current Stage
Late Stage
Company data provided by crunchbase
logo

Orion

Your AI Copilot