Ishpi Information Technologies, Inc. (DBA ISHPI) · 3 months ago
Data Architect - SME (Remote)
Ishpi Information Technologies, Inc. (ISHPI) provides information technology solutions for the Department of Defense and Department of Navy. They are seeking a Data Architect who will leverage expertise in data engineering and ETL to architect, develop, and deploy scripts for processing structured and unstructured data for long-term storage and analysis.
Information TechnologySoftware
Responsibilities
Experience Engineer ELT pipelining for data ingest and egress processes in a Databricks Lakehouse Architecture with consistent performance and scalability using established Data Framework
Experience with Medallion Architecture utilizing Landing Zone and Bronze, Silver and Gold delta tables
Expert experience with SPARKS, Python and Databricks SQL in ELT pipeline development to include knowledge of Databricks, Python, and PySpark
Have experience writing and tuning complex SQL queries used in the ELT development
Architecting, implementing and Enhance ELT Framework to include Structured Streaming
Experience with the AWS preferably GovCloud, and Data Ingest/Transformation/Settings processes
Experience with AWS Services like Relational Database Services (RDS), Data Migration Service (DMS), CloudFormation, Terraform, S3 bucket, lambda function, SNS and Event Viewer
Architecting, implementing, and supporting software and data technology, in the cloud
Have worked on teams that practice Agile methodologies
Experience working with Databricks Workspace Notebooks
Perform Data Engineering on Databricks Development and Production Environments
Understanding of programming and data engineering concepts and best practice
Experience working with both structured, semi-structured, and unstructured data to include data parsing, transformation, schema definition, and query/analysis
Create Standard Operation Procedure (SOP) for onboarding new application solutions
Provide assistance and guidance on implementing current Data Management Solutions
Provide technical advice to Data Engineering and BI Modernization Efforts
Provide management feedback from research and investigation to latest trends in Data Management Systems
Troubleshoot, fix, tune and enhance the end to end ELT Pipeline Processes
Ability to work both independently and collaboratively
Experience using GIT, JIRA/ServiceNow, and Microsoft tools (365 Office, Excel, Teams)
Consulting with leadership, peers, teammates, and business partners to appreciate current and anticipate future software and data technology needs
Qualification
Required
Technical Training in Data Design or Database Architecture or Metadata Management Platforms
Eighteen (18) years of hands-on experience architecting software solutions for IT projects
Designed and built relational databases in a data warehouse environment, which includes data design, database architecture, and metadata repository creation
Performed data access analysis design, and archive/recovery design and implementation
Advanced understanding of and ability to apply principles, theories, and concepts of all-things data – databases, data integration, data governance, data science, advanced analytics & reporting, cloud-based data management, and artificial intelligence/machine learning
The ability to understand business objectives for data and engineer business solutions that leverage current and innovative data technology capabilities and provide valuable insights to relevant stakeholders
The ability to set architectural direction and standards while applying analytical, engineering, hardware, and software design theories to develop/maintain organizational strategy
Experience building application and/or data architecture roadmaps
Experience designing, integrating, and managing complex applications & data solutions
Experience working in a fast-paced, competitive information technology organization
Experience Engineer ELT pipelining for data ingest and egress processes in a Databricks Lakehouse Architecture with consistent performance and scalability using established Data Framework
Experience with Medallion Architecture utilizing Landing Zone and Bronze, Silver and Gold delta tables
Expert experience with SPARKS, Python and Databricks SQL in ELT pipeline development to include knowledge of Databricks, Python, and PySpark
Have experience writing and tuning complex SQL queries used in the ELT development
Architecting, implementing and Enhance ELT Framework to include Structured Streaming
Experience with the AWS preferably GovCloud, and Data Ingest/Transformation/Settings processes
Experience with AWS Services like Relational Database Services (RDS), Data Migration Service (DMS), CloudFormation, Terraform, S3 bucket, lambda function, SNS and Event Viewer
Architecting, implementing, and supporting software and data technology, in the cloud
Have worked on teams that practice Agile methodologies
Experience working with Databricks Workspace Notebooks
Perform Data Engineering on Databricks Development and Production Environments
Understanding of programming and data engineering concepts and best practice
Experience working with both structured, semi-structured, and unstructured data to include data parsing, transformation, schema definition, and query/analysis
Create Standard Operation Procedure (SOP) for onboarding new application solutions
Provide assistance and guidance on implementing current Data Management Solutions
Provide technical advice to Data Engineering and BI Modernization Efforts
Provide management feedback from research and investigation to latest trends in Data Management Systems
Troubleshoot, fix, tune and enhance the end to end ELT Pipeline Processes
Ability to work both independently and collaboratively
Experience using GIT, JIRA/ServiceNow, and Microsoft tools (365 Office, Excel, Teams)
Consulting with leadership, peers, teammates, and business partners to appreciate current and anticipate future software and data technology needs
Must be a U.S. Citizen with an active security clearance and the ability to obtain T5 eligibility
Must have at least one of the following: CCNA (Cisco Certified Network Associate Security), CySA+ (CompTIA Cybersecurity Analyst), GICSP (Global Industrial Cyber Security Professional), GSEC (GIAC Security Essentials Certification), CompTIA Security+ CE, CND (Certified Network Defender), or SSCP (Systems Security Certified Practitioner) or the ability to obtain one within 3 months of hire date
Company
Ishpi Information Technologies, Inc. (DBA ISHPI)
ISHPI works in concert with other defenders of the Homeland to fortify national preparedness, agility, strength and advantage in the cyber domain – a readiness state we refer to as an Holistic CyberStance™.