Computomic ยท 21 hours ago
Solutions Architect
Computomic is a rapidly growing company focused on delivering innovative Data & AI solutions. They are seeking a Resident Solutions Architect to lead enterprise-scale Databricks migration projects and provide thought leadership in data architecture and governance.
Cloud Data ServicesData IntegrationData ManagementInformation Technology
Responsibilities
Be a core member of our rapidly growing Databricks practice
Work directly with end customers and architect, scope, negotiate & lead enterprise scale Databricks migration projects
Provide thought leadership in the areas of data migration, master data management, data modeling, data governance, data transformations, curation and data integration
Develop data architecture blueprints, patterns and frameworks that will enable reuse and standardization
Grow the practice by influencing sales deals and assist with scoping, solutioning and estimating effort
Lead efforts to develop reusable frameworks, accelerators and internal product development
Help us hire, train and develop highly differentiated and diverse team of Big Data experts
Qualification
Required
7+ years experience of data engineering, data platforms & analytics
10+ years of consulting experience
Minimum 6-8+ projects delivered with hands-on experience in development on databricks
Current knowledge across the Databricks product & platform features - and/ or complete Databricks Data Engineering Professional Certification (upon joining)
Deep understanding and experience working with modern cloud data architectures and engineering for one or more of the common cloud ecosystems - AWS, Azure or GCP
Familiarity with cloud native technologies specifically - Python / PySpark / JavaScript, CI/CD for production deployments , ML Ops, cloud devops, containers (kubernetes/docker, etc.)
Deep experience with distributed computing with Spark, with knowledge of Spark runtime intervals
Strong abilities to provide a firm point of view on core cloud platform capabilities, security, and best practices
Knowledge of cloud and Big Data ecosystems to advise clients on optimal solutions and best practices
Understanding of cloud data architecture and data integration patterns (Databricks, Starburst, Azure Data Factory, AWS Glue and others), storage and processing (Redshift, Azure Synapse, BigQuery, Snowflake); Infrastructure as code (CloudFormation, Terraform)
Understanding of enterprise data concepts such as Master Data Management and Enterprise Data Warehouse, experience with MDM standards
Understanding of SQL, report generation using visualization tools such as Tableau/Power BI, programming using Python/Scala/Spark
Ability to identify, debug bottlenecks and significantly optimize slow running data pipelines
Experience migrating applications from legacy Hadoop or Data Warehouses to the cloud running Apache Spark or Databricks a huge plus
Preferred
Demonstrating prior Big 4 or proven consulting experience in strategy through execution projects is a plus
Experience leading and working with large Cloud Data Platform, Cloud Data migration or Enterprise Information Management programs
You bring an uncompromising Growth mindset
You are highly motivated, creative in your approach to technical problems and know how to leverage both internal and external networks
You invest in keeping technical skills updated and are constantly looking for the next big challenge
You will bring both broad and deep knowledge in Data Engineering and can architect a solution by mapping a customer business problem to an end-to-end solution
You are resourceful, confident and composed under pressure
Benefits
401k Plan
Robust Health and Wellness Benefits
Referral Program
Paid Time Off and Sick Leave
Professional Development Assistance
Excellent work culture
Remote work in eastern or central time zones
Training & Certification Plan, on Databricks + adjacent technologies
Career Development Plan, including management/ leadership training