Data Capital Incorporation ยท 8 hours ago
Senior Data Architect
United States
Full-time
Remote
Senior Level, Lead/Staff
10+ years expData Capital Incorporation is seeking a Senior Data Architect to serve as the primary data solutions architect for a data services/visualization platform for a large federal agency. The role involves leading the design of data lakes, data warehouses, and visualization services, as well as optimizing data solutions and providing technical guidance to the team.
Information Technology & Services
No H1B
U.S. Citizen OnlyHiring Manager
Srinivas Anepalli
Responsibilities
This position will be responsible for serving as the primary data solutions architect for a data services/visualization platform for a large federal agency. The architect will lead the design of data lakes, data warehouses, and visualization services and work with data/cloud engineers to design data pipelines to ingest, clean and transform both batch and streaming data
Leading the design of data warehouses, data lakes and datamarts including both the logical and physical models
Assist in soliciting and assessing requirements for the data warehouses/data lakes among data consumers/analysts, visualization specialists, programmers, and engineers
Optimizing the design and tuning the performance of data warehouses for efficient loading and high performance for data queries
Facilitating change control processes for the data model within the repositories including integrating with CI/CD pipelines
Designing and implementing a metadata repository to be used for data discovery/catalog services across the enterprise
Provide technical guidance and mentorship to other members of the technical team
Qualification
Required
Data Warehousing/Data Architect Experience (10+ years)
Data Architecting a data lake and/or data warehouse model including defining the use of standard conventions using cloud components (AWS S3, AWS Redshift, AWS Aurora Postgres)
Creating logical and physical data models for data repositories containing a number of heterogenous sources
Creating work streams for the development team using an Agile framework; developing a roadmap Initiatives and Epics and work with a scrum master to define stories with clear acceptance criteria
Optimizing data warehouses for high performance for varying types of use cases (high frequency loads, large loads, high frequency queries)
Implementing various archiving and partitioning approaches to optimize data ingestion, data storage costs and meet data retention requirements
Software Development, Leadership and Customer Experience (5+ years)
The Data Architect should be able to elicit requirements from the client including complex process flows and design data models that will support the development of the application
Ability to communicate effectively with senior leadership including translating complex technical concepts into specific and understandable technology recommendations
Demonstrate an understanding of cloud components in either AWS or Azure to design a cloud-native technical solution for the application e.g. the use of AWS Lambdas, SNS/queues, API Gateway, Cloudfront, CloudFormation
Will lead the data model and process flow controller design to support an efficient and intuitive user interface view for the application
The Data Architect will be responsible for creating work streams for the development team to build out the functional infrastructure in Data bricks and create the application using an Agile framework; developing a roadmap Initiatives and Epics to accomplish the development plan within an Agile framework and work with a scrum master to define stories with clear acceptance criteria
Experience designing data models for transactional applications
Experience working with Data bricks or other data engineering, machine learning, data analytics platform to build a data lakehouse and data warehouse solution
Experience with data replication, high availability, and data migrations tools and techniques
Preferred
Use of integrating visualization tools, such as Tableau, Qlik, Socrata, with data lakes and data warehouses)
Use of Big Data tools including Apache Spark, Databricks, Sagemaker and MLFlow
Experience with Azure data tools including Synapse and Data Factory
Net Core 5/6/7 Web Application development experience, particularly on Blazor and Syncfusion Blazor area
AWS Solution Architect Certification, Databricks certification
Bachelor's Degree in a related area or equivalent experience
Company
Data Capital Incorporation
Data Capital Inc is a technology-focused company with comprehensive experiences in developing and managing solutions in the areas of CRM(Customer Relationship Management), Big Data, Advanced Search Solutions (dealing with large data volumes including text and images), DevOps, Data Science, Cloud Engineering, Artificial Intelligence/Machine Learning (AI/ML)and Robotic Process Automation (RPA), IT Infrastructure development and maintenance and cyber Security.
51-200 employees
Funding
Current Stage
Growth StageCompany data provided by crunchbase