Databricks / Snowflake Administrator

About the Role

We are seeking an experienced Databricks and Snowflake Administrator to manage, optimise, and secure our enterprise data platforms. This role involves working closely with data engineering, analytics, and security teams to ensure high availability, performance, and compliance of our cloud-based data environment.

Key Responsibilities

Databricks Administration

 Manage and monitor Databricks workspaces, clusters, and jobs.

 Optimize cluster configurations for cost and performance efficiency.

 Implement security controls (IAM roles, secret scopes, network policies).

 Automate cluster deployments and job scheduling using Terraform, CI/CD pipelines, or Databricks REST APIs.

 Manage libraries, runtime versions, and notebook environments.

 Perform audit logging, usage tracking, and cost reporting.

Snowflake Administration

 Manage Snowflake warehouses, databases, schemas, roles, and users.

 Optimize query performance and warehouse sizing.

 Implement RBAC (Role-Based Access Control) and data security best practices.

 Monitor query performance, storage consumption, and credit usage.

 Automate provisioning, backup, and maintenance using scripts and orchestration tools.

 Integrate Snowflake with ETL/ELT pipelines, BI tools, and external systems.

Required Skills & Qualifications

 5+ years of experience in cloud data platform administration (Azure Databricks, Snowflake).

 Strong expertise in cluster tuning, job orchestration, and query performance optimization.

 Experience with Terraform, Azure DevOps, Jenkins, or similar CI/CD tools.

 Proficiency in SQL and Python for administrative automation.

 Familiarity with network security, VPC peering, and data encryption (KMS, Key Vault).

 Understanding of cost management and monitoring tools (Azure Monitor, CloudWatch, Snowflake Usage).

 Excellent problem-solving and communication skills to work with cross-functional teams.

Preferred Skills

 Knowledge of Delta Lake, Unity Catalog, and Databricks SQL.

 Familiarity with data governance frameworks (e.g., Collibra, Alation).

 Exposure to multi-cloud or hybrid environments.

 Certifications such as Databricks Certified Data Engineer / SnowPro Advanced.