Cloud Resources LLC · 2 days ago
Data Architect
Wonder how qualified you are to the job?
Insider Connection @Cloud Resources LLC
Responsibilities
Create and maintain optimal data pipeline architecture.
Assemble large, complex data sets that meet functional / non-functional business requirements.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL server and Azure ‘big data’ technologies.
Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
Work with data and analytics experts to strive for greater functionality in our data systems.
Great adaptability to the technology change and capability to design advanced Data Architectures
Support software developers, database architects, data analysts and data scientists on data initiatives and ensure optimal data delivery architecture throughout projects.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
Mandatory experience in one of the programming languages - Python or Java
Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
Strong analytic skills related to working with unstructured datasets.
Build processes supporting data transformation, data structures, metadata, dependency and workload management.
Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
Experience supporting and working with cross-functional teams in a dynamic environment.
Experience in building Data-Ingestion and ETL/ELT Pipelines
Overall, 8 years of experience, should have experience using the following software/tools:
Strong working experience in Azure Cloud offerings especially for data engineering work (Azure data lake, Azure Data factory, data bricks, azure SQL)
Experience with storage formats - Parquet, Avro
Experience with API authentication and endpoint consumption
Experience with data pipeline and workflow management tools
Must have: Experience with big data tools: Spark, Python, Azure Cloud, Power BI.
Preferred
Preferred Healthcare domain knowledge
Hands-on working experience in Linux & Windows environment
Hands-on working experience in bash scripting
Good to have: Experience in stream processing architecture.
Good to have: Experience in Webapp Development (C#, API development)
Benefits
Health Insurance
Company
Cloud Resources LLC
Cloud Resources is a highly motivated and results-oriented consulting firm specialized in cutting edge next-generation Software Development, Technology and Cloud Services.
H1B Sponsorship
Cloud Resources LLC has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Trends of Total Sponsorships
2023 (26)
2022 (14)
2021 (15)
2020 (23)
Funding
Current Stage
Growth StageCompany data provided by crunchbase