Databricks Administrator
Our client is growing and seeking to hire an experienced Azure Databricks Platform Administrator to join our talented Information Technology team. The position offers growth, flexibility and a collaborative work environment.
The Azure Databricks Platform Administrator oversees the design, implementation, and maintenance of Databricks clusters, ensuring scalability, performance, and security. They collaborate with leadership to align platform capabilities with business goals and provide escalated support to users. Responsibilities also include enforcing policies, overseeing access controls, and automating admin tasks.
In this position you should have the following: excellent interpersonal skills with the ability to communicate at all levels. Strong problem solving and creative skills and the ability to exercise sound judgment. Most important, demonstrate a high level of integrity and dependability with a strong sense of urgency and results-orientation.
This role oversees the entire Databricks infrastructure, ensuring its scalability, performance, and security. They lead a team of administrators and align platform capabilities with business goals.
Responsibilities:
- Strong experience with Azure, Databricks and the enterprise tools they interact with (e.g Salesforce, Informatica)
- Oversee the design, implementation, and maintenance of Databricks clusters.
- Ensure the platform’s scalability, performance, and security.
- Develop and enforce policies and procedures for platform administration.
- Collaborate with leadership to align platform capabilities with business goals.
- Provide escalated support and troubleshooting to users.
- Oversee maintenance of role-based access to data and features in the Databricks Platform using Unity Catalog.
- Oversee implementation of external access controls for outside teams using service principles, SQL warehouses and Delta Sharing
- Knowledge of Databricks development, including Azure Storage Technologies
- Support Application integration and security management
- Azure Cloud with Network security
- Excellent verbal/written communication, collaboration, analytical and presentation skills Job responsibility
- Provide operational support as Azure Databricks admin
- Responsible for user provisioning, access controls and group administration
- Manage –- Databricks clusters and permissions- Azure Data Storage, key vault, Tokens and secrets- Code deployment to production- Linked services, SQL endpoints
- Responsible for clusters health and Performance management
- Continuously improve processes and systems used to manage infrastructure, users and external access.
- Lead implementation of service principles and access tokens for external users.
- Oversee creation of queries and dashboards to monitor critical systems and processes.
- Review and maintain documentation for users and administrators.
- Automate common admin tasks using Databricks notebooks.
- Manage workflow tags, cluster tags, workflow naming convention enforcement.
- Review clusters health check and best practices implementation.
- Ensure regular backup and recovery.
- Oversee privilege reviews on users and resources.
- Stay current with industry trends and advancements in Databricks and cloud technologies.
- Lead and mentor a team of Databricks administrators.
- Provide training to junior members of the team and act as a point of escalation for complex questions and issues.
- 9 years of relevant experience required.
- Experience with Azure Databricks preferred.
- Bachelor’s degree in related field required (combination of education and experience may be considered in lieu of degree)
- Strong understanding of data engineering needs
- Strong understanding of Azure infrastructure required by Databricks
- Experience with compliance audits/audit documentation
- Experience using Databricks APIs with tools like Postman
- Understanding of the Databricks workspace and development environment
- Experience using Bitbucket to manage source code, and Understand Azure DevOps, managed code deployment and knowledge in CI/CD pipelines
- Strong SQL skills for creating admin related queries and dashboards
- Strong debugging skills
- Ability to do risk analysis for 3rd party integrations with Azure resources.
- Familiarity with Dynatrace.
- Proficiency in Spark, Python, SQL, and cloud platforms (AWS, Azure, or GCP).
- Strong knowledge with Python, PowerShell, pySpark
- Strong in Python and PowerShell scripting
Recommended Jobs
Diesel Mechanic
We are seeking a skilled and motivated Equipment Mechanic to join our client's team. As a Mechanic, you will be responsible for diagnosing, repairing, and maintaining heavy equipment used in various …
Sales Representative
IDT is currently looking for a Money Transfer Sales Representative. IDT is a leading communications and financial services company looking for enthusiastic and energetic Sales Representatives that c…
Earn 100K+, Pre-Qualified Leads, Elite Outside Sales Team, Work That Mat
An Exciting Opportunity Awaits You in Estate Planning Sales with $100,000+ Earning Potential and a Purpose-Driven Career! Truly A Job with a Purpose! As this product is a Need vs a Want. Great P…
Sr. Salesforce Developer
Sr. Salesforce Developer Our client is seeking an Engineer to build, test and monitor solutions that run on our best-of-class integration platform to interconnect cloud and enterprise data. These …
Hospitalist IM Opportunity Near the Gulf Coast
(Physician/MD qualifications required) Hospitalist- Internal Medicine - Hospitalist IM Opportunity Near the Gulf Coast A rapidly growing Alabama practice seeks BE|BC Internal Medicine physicians to…
Assistant Athletic Trainer - Part Time
Department: Team Operations Reports to: Head Athletic Trainer Position Summary This position is based in Huntsville, Alabama at John Hunt Park and Joe Davis Stadium. This role primarily in…
Marketing Events Specialist
The Event Marketing Specialist we need is an outgoing team player who thrives on meeting new people, enjoys being the face of the Cantey brand, and enjoys the buzz of live events. You don’t need to …
Python Developer
We are currently hiring Python Developers. As a Python Developer, you will be responsible for developing and maintaining Python-based applications. At least 5 years of relevant experience as a …
Wildlife Service Professional
WHY WORK WITH US? Waynes is a leader in modern pest control and lawn care with branches throughout Alabama, Mississippi, Florida, and Tennessee. We embody our core values of Integrity, Courage, Perse…
Bartender/Server
Jack Brown's Beer & Burger Joint is a dive bar with a top-notch burger. Born out of the minds of childhood best friends Aaron Ludwig and Mike Sabin, Jack Browns is a crossroads of great quality and q…