Amity Tech corporation · 2 days ago
Azure Data Engineer
Kansas City, MO
Full-time
Hybrid
Mid Level
3+ years expAmity Tech corporation is seeking an Azure Data Engineer who possesses a deep understanding of data architecture and engineering. The role involves designing, building, and maintaining data processing pipelines, as well as collaborating with various teams to translate business requirements into technical specifications.
Information Technology & Services
Hiring Manager
Sujatha M.
Responsibilities
Design, build, implement, and maintain data processing pipelines for the extraction, transformation, and loading (ETL) of data from a variety of data sources
Develop robust and scalable solutions that transform data into a useful format for analysis, enhance data flow, and enable end users to consume and analyze data faster and easier
Write complex SQL queries to support analytics needs
Evaluate and recommend tools and technologies for data infrastructure and processing
Collaborate with engineers, data scientists, data analysts, product teams, and other stakeholders to translate business requirements to technical specifications and coded data pipelines
Work with tools, languages, data processing frameworks, and databases such as R, Python, SQL, MongoDB, Redis, Hadoop, Spark, Hive, Scala, BigTable, Cassandra, Pesto, Strom
Work with structured and unstructured data from a variety of data stores, such as data lakes, relational database management systems, and/or data warehouses
Responsible for design, implementation, and support of data-driven projects
Maintains strong working relationships with multiple technical and non-technical SMEs within the company
Able to communicate project needs efficiently to parties with differing levels of technical understanding
Well versed in on-premise SQL Server and Microsoft Azure-based SQL, as well as related concepts – administration, best-practice development, and troubleshooting
Able to build and maintain processes supporting data movement and transforms, including Scala/Python script development
Qualification
Required
Deep understanding of data architecture, data engineering, data analysis, reporting and a basic understanding of data science techniques and workflows
Experience creating data products supporting analytic solutions
Self-motivated with strong problem-solving and self-learning skills
Strong advocate of a culture of process and data quality in a cross-functional team
Design, build, implement, and maintain data processing pipelines for the extraction, transformation, and loading (ETL) of data from a variety of data sources
Develop robust and scalable solutions that transform data into a useful format for analysis, enhance data flow, and enable end users to consume and analyze data faster and easier
Write complex SQL queries to support analytics needs
Evaluate and recommend tools and technologies for data infrastructure and processing
Collaborate with engineers, data scientists, data analysts, product teams, and other stakeholders to translate business requirements to technical specifications and coded data pipelines
Work with tools, languages, data processing frameworks, and databases such as R, Python, SQL, MongoDB, Redis, Hadoop, Spark, Hive, Scala, BigTable, Cassandra, Pesto, Strom
Work with structured and unstructured data from a variety of data stores, such as data lakes, relational database management systems, and/or data warehouses
Responsible for design, implementation, and support of data-driven projects
Maintain strong working relationships with multiple technical and non-technical SMEs within the company
Able to communicate project needs efficiently to parties with differing levels of technical understanding
Well versed in on-premise SQL Server and Microsoft Azure-based SQL, as well as related concepts – administration, best-practice development, and troubleshooting
Able to build and maintain processes supporting data movement and transforms, including Scala/Python script development
3+ years' experience as a Data engineer or a similar role developing modern data pipelines and applications for analytics use cases
3+ years' experience as a SQL Server DBA/Developer
Experience with Azure Data Factory, DataFlows, and DataBricks (Python/Scala familiarity is a plus)
Working knowledge of CI/CD methodologies specific to Azure DevOps pipelines with Terraform code
Experience with big data technologies: Hadoop, Spark (Scala, PySpark), etc
Experience building and optimizing ‘big data' pipelines and datasets using workflow management tools: Airflow, Ambari, etc
Experience performing root cause analysis on errors related to data ingestion, movement, and transforms
Experience working with unstructured datasets
Experience supporting and working with cross-functional teams in a dynamic environment
Strong technical project management and organizational skills
Experience with traditional data warehouse schema design (star/snowflake schema, dimensional modeling, etc.)
College degree in Computer Science, Statistics, Informatics, Information Systems
Company
Amity Tech corporation
We are an IT consulting company help to find the right talent to clients requirements.
Founded in 2019Dallas, US
2-10 employeesFunding
Current Stage
Early StageCompany data provided by crunchbase