Take2 Consulting, LLC ยท 12 hours ago
Platform Engineer
Washington, DC
Contract
Onsite
Senior Level
7+ years expTake2 Consulting, LLC is seeking a Platform Engineer to manage and optimize their Databricks platform in support of Enterprise Data Platform initiatives. The role involves overseeing platform operations, security, and governance configuration to ensure the environment is compliant and cost-effective for analytics and AI/ML workloads.
ConsultingLegalManagement Consulting
No H1B
Security Clearance Required
Responsibilities
Administer Databricks accounts and workspaces across SDLC environments, standardizing configuration and operational patterns
Configure and maintain clusters, compute resources, jobs, SQL warehouses, runtime versions, libraries, repos, and workspace settings
Implement and manage platform monitoring, alerting, operational dashboards, and health checks; maintain runbooks and operational procedures
Provide Tier 2/3 operational support, troubleshoot incidents, perform root cause analysis, and drive remediation efforts
Manage change control processes for upgrades, feature rollouts, configurations, and integrations, documenting impacts and rollback plans
Enforce least privilege access policies across platform resources, managing secrets and secure credential handling, including secret scopes and key management integrations
Enable and maintain audit logging, access visibility, and support security reviews and evidence collection
Administer Unity Catalog governance for metastores, catalogs, schemas, and tables, managing ownership, grants, and environment/domain patterns
Configure external locations, storage credentials, and governed access to cloud object storage, supporting metadata and lineage integrations
Coordinate secure connectivity with cloud and network teams, implementing private access, egress controls, and firewall/proxy configurations
Implement cost management measures such as cluster policies, auto-termination, workload scheduling, and capacity planning
Generate and analyze usage and cost insights, recommending optimizations to reduce waste
Automate administrative and configuration tasks via APIs, CLI, or Infrastructure as Code (IaC) tools like Terraform
Maintain detailed platform documentation, including configurations, security standards, onboarding procedures, and troubleshooting guides
Design and test backup and disaster recovery procedures for workspace configurations, job definitions, and metadata, ensuring alignment with recovery objectives
Optimize platform performance through query tuning, autoscaling, Photon enablement, and Delta Lake strategies
Administer Delta Live Tables pipelines, monitor job health, address data quality issues, and coordinate pipeline configurations
Manage third-party ecosystem integrations, including BI tools and metadata catalogs
Implement deployment automation for workspace resources using Asset Bundles and CI/CD workflows
Conduct capacity planning, scalability analysis, and proactive resource management during peak workloads
Facilitate user onboarding, including access provisioning, training, and creating self-service documentation
Qualification
Required
A bachelor's degree in a related field or equivalent practical experience is required
Relevant certifications include Databricks Certified Data Engineer Associate/Professional and AWS Certified Solutions Architect Associate or Professional
Public Trust clearance
Minimum of 7 years of experience supporting cloud and data platform operations
Extensive hands-on experience administering Databricks environments, including workspace and cluster management
Strong knowledge of cloud security, IAM roles/policies, and networking (AWS)
Proficiency with scripting, IaC (Terraform), and automation of platform configurations
Experience implementing data governance, metadata, and lineage controls
Familiarity with compliance frameworks such as FedRAMP, HIPAA, SOC2, and related regulatory requirements
Knowledge of SQL, Python/Scala basics, and troubleshooting data workflows
Ability to communicate technical issues to diverse stakeholders and document platform procedures
Preferred
Expertise in cloud security and networking services such as PrivateLink, KMS, CloudTrail, and S3 policies
Experience with advanced Delta Lake operations, DLT pipelines, and high-performance query tuning
Familiarity with external BI tools and metadata integrations
Skilled in implementing CI/CD workflows for data and notebook deployment using Asset Bundles and automation tools
Knowledge of platform cost management and optimization strategies
Company
Take2 Consulting, LLC
Tech evolves. Industries shift. Take2 ensures your team moves with it.
1001-5000 employees
Funding
Current Stage
Late StageLeadership Team
Serge Khoury
Founder & Managing Partner
Company data provided by crunchbase