Role Name: Databricks Sr. Architect
Location: Bellevue, WA (Onsite)
Start date: 12 Months
JOB DESCRIPTION:
Strong solution architect with experience in end-to-end solution on databricks across Azure and have implemented Lakehouse strategies, data pipeline governance.
Designed and implemented security solutions and best practices.
Hands on experience in providing scalable solution leveraging the complete databricks medallion architecture and technology stack including Delta lake , Unity catalog , ML flow and Databricks SQL.
Has experience in implementation of Unity catalog for centralized governance , lineage and data discovery
Develop and monitor effective solutions to optimize sizing, autoscaling and cost.
Responsible to provide technical guidance and direction in defining the data architecture strategy
Hands on experience on Azure cloud IaaS, PaaS Architect, Design, engineering & solid understanding of native Cloud architecture/On-Prem networking
Experience in migrating On-premises database to Azure SQL Database, SQL Managed instance, SQL Elastic pool on Azure & SQL server in Azure VM.
Proficient in Python coding and frameworks knowledge.
Responsibilities
Configure Databricks Cluster, and Unity Catalog repository.
Responsible for Solutioning, Administration, Configuration, and Optimization of Azure Databricks platform.
Build large-scale batch and real-time data pipelines with data processing frameworks with Databricks technology in Azure cloud platform.
Landing zone architecture for Databricks: accounts, workspaces, UC metastore(s), external locations, storage hierarchy, and networking.
Security & compliance design (e.g., PII/PHI handling, audit, retention) aligned to enterprise and regulatory needs.
Sizing & capacity recommendations (clusters, pools, serverless/DBR runtimes, model serving).
Data protection: storage firewalling, encryption at rest/in transit, token lifecycles, PAT policy.
Cluster policies (standardized node families, autoscaling, spot/preemptible usage policy), pools, serverless enablement (where applicable).
Best Regards,
Chetna
630-425-6471 -D
815-600-8657-Fax
Chetna@smartcaliber.com
Truth Lies in Heart
...Entry-Level Medical Coder / Billing Assistant We are seeking a motivated Entry-Level Medical Coder / Billing Assistant to join our administrative... ...field for individuals interested in medical billing and coding , with plenty of room to grow your skills and career....
...Werde Teil des Teams und gestalte die Zukunft mit. Tasks Remote- und Vor-Ort-Support fr Hard- und Software Fehleranalyse und... ...Unternehmen Flexible Arbeitszeiten mit Kernarbeitszeiten fr eine gute Work-Life-Balance Ein dynamisches, internationales Team mit...