Databricks Specialist

About One51

One51 is a specialist Data, Analytics & AI consulting firm helping organisations unlock value from their data through modern platforms, analytics, reporting, and AI-driven solutions. We partner with clients across industries to design and deliver scalable, high-impact data solutions using technologies such as Databricks, Microsoft Fabric, Azure, Snowflake, and modern cloud data platforms.

At One51, we combine deep technical expertise with a pragmatic consulting approach. Our team works closely with clients to solve real business problems, modernise data environments, and enable better decision-making through trusted data and AI-driven insights.

The Role

We are looking for an experienced and technically strong Databricks Specialist to join our growing consulting team. This role is ideal for someone passionate about architecting, implementing, optimising, and supporting enterprise-scale Databricks environments and modern data platforms.

As a Databricks Specialist at One51, you will work across a range of client engagements focused on platform architecture, engineering best practices, cloud data solutions, AI enablement, and modern analytics capabilities. You will collaborate with architects, data engineers, AI engineers, consultants, and client stakeholders to deliver scalable and high-performing Databricks solutions.

Key Responsibilities

• Design and architect enterprise Databricks environments aligned to client business and technical requirements.
• Configure, optimise, secure, and maintain Databricks platforms across development, test, and production environments.
• Develop and implement scalable data engineering and analytics solutions using Databricks technologies.
• Design and support CI/CD processes for Databricks development components, including notebooks, pipelines, workflows, libraries, and deployment artefacts.
• Implement DevOps and automation practices for Databricks platform management and solution delivery.
• Perform platform performance tuning, workload optimisation, monitoring, and cost management activities.
• Support data ingestion, transformation, orchestration, and analytics workloads.
• Work with structured, semi-structured, streaming, and unstructured datasets.
• Collaborate with engineering and AI teams to support advanced analytics and AI workloads.
• Implement governance, security, access control, and operational best practices within Databricks environments.
• Participate in solution architecture, technical discovery workshops, and stakeholder engagement sessions.
• Prepare technical documentation, architecture diagrams, operational procedures, and implementation guides.
• Contribute to reusable frameworks, accelerators, standards, and best practices within One51.

Skills & Experience

Essential

• 5+ years’ experience in Data Engineering, Platform Engineering, Analytics Engineering, or related technical roles.
• Strong hands-on experience designing and architecting Databricks environments.
• Experience configuring, administering, performance tuning, and maintaining Databricks platforms.
• Strong experience developing and managing CI/CD processes for Databricks components, including notebooks, pipelines, workflows, and deployment artefacts.
• Experience with Databricks workflows, Delta Lake, Unity Catalog, and Lakehouse architecture principles.
• Strong Python, SQL, and Spark/PySpark development skills.
• Experience implementing data engineering and analytics solutions in cloud environments.
• Experience with DevOps, Infrastructure as Code, Git integration, and deployment automation.
• Strong understanding of modern data platform architecture and engineering best practices.
• Experience working with APIs, orchestration tools, and multiple data integration patterns.
• Strong analytical, troubleshooting, and problem-solving skills.
• Ability to communicate technical concepts to both technical and non-technical stakeholders.
• Experience working within consulting or project-based delivery environments.

Desirable

• Experience with Microsoft Fabric, Azure Data Factory, Synapse Analytics, or Snowflake.
• Experience with Azure cloud services and modern cloud-native architectures.
• Exposure to AI, machine learning, or Generative AI workloads on Databricks.
• Experience with monitoring and observability platforms.
  Understanding of data governance, security, and compliance best practices.
• Exposure to Agile delivery methodologies.
• Databricks certifications or relevant cloud certifications.

Personal Attributes

• Passion for modern data engineering and platform technologies.
• Strong communication and stakeholder engagement skills.
• Collaborative and team-oriented mindset.
• Proactive, adaptable, and solutions-focused approach.
• Professional and client-focused attitude.
• Curious mindset with a desire for continuous learning and improvement.

What We Offer

• Opportunity to work on modern cloud and analytics platforms.
• Exposure to diverse industries and complex enterprise data challenges.
• Supportive and collaborative consulting culture.
• Career growth and ongoing learning opportunities.
• Flexible and hybrid working arrangements.
• Opportunity to contribute to One51’s modern data platform and AI capabilities.

Preferred Qualifications

• Bachelor’s degree in Computer Science, Software Engineering, Information Systems, Data Engineering, or a related discipline.
• Relevant Databricks, Microsoft, or cloud platform certifications are highly regarded.

Recruitment Process

One51 welcomes applications from candidates across different levels of experience, including emerging platform specialists, mid-level engineers, and experienced consultants. We recognise that strong potential can come from a range of professional backgrounds and experiences.

Each application will be assessed based on a combination of:

• Previous consulting or client-facing experience.
• Technical capability across Databricks architecture, platform engineering, DevOps, and modern data platforms.
• Problem-solving ability and communication skills.
• Alignment with One51’s collaborative and client-focused culture.
• Demonstrated willingness to learn and grow within a consulting environment.

The recruitment process may include an initial screening discussion, technical and consulting capability assessment, and interviews with members of the One51 leadership and delivery teams.

How to Apply

If you are passionate about Databricks and modern data platforms and enjoy helping organisations build scalable, high-performing analytics and AI solutions, we would love to hear from you.

Please submit your resume and a brief cover letter outlining your experience and interest in joining One51 to careers@one51.com.au.