AI Platform Engineer L3 (GPU & AI Infrastructure)

🗓️ Full-time (Permanent)

📍 Location: Australia (Remote) or Sydney (Hybrid)

About Sharon AI

Sharon AI is an Australian neocloud, delivering trusted AI infrastructure organisations need to build, train and run AI at scale. We support customers across the full AI lifecycle, from training through to inference and agentic AI, drawing on a strong ecosystem of technology and co-location partners to deliver capability where it's needed. As the first neocloud to join NVIDIA's AI Compute Program, we're growing quickly, scaling our AI Factory platform to meet rising demand for advanced compute.

The Role

As Sharon AI continues to grow, we're looking for an experienced AI Platform Engineer L3 to join our NOC Platform Operations team. Reporting to the NOC Manager, you'll take senior technical ownership of the reliability, performance and restoration of our CPU and GPU infrastructure across Australian and global AI Factory and data centre environments.

You'll be a senior hands-on escalation point across Linux, GPU compute, virtualisation, Kubernetes, storage and infrastructure networking. Working closely with customer technical teams, Network and Fabric Operations, Data Centre Engineering and technology vendors, you'll resolve complex incidents and drive lasting improvements to platform reliability.

What You’ll Be Doing

• Lead advanced Linux administration, performance optimisation, patching, troubleshooting and system recovery.

• Diagnose complex CPU/GPU and server faults, including GPU health, XID/ECC errors, drivers, firmware, PCIe and NVLink.

• Troubleshoot and optimise Kubernetes, containers, KVM/libvirt virtualisation and distributed storage for AI/HPC workloads.

• Investigate host-to-fabric and workload connectivity across Ethernet, RoCE/RDMA and InfiniBand.

• Own L3 escalations, major incident recovery and verified service restoration, including participation in the senior technical on-call rotation.

• Lead root cause analysis, permanent remediation and reliability improvements to prevent recurring incidents.

• Partner with customer, network, data centre, field, service and engineering teams to resolve production issues.

• Improve diagnostics, observability, automation, operational readiness and technical documentation.

• Mentor L1/L2 engineers, share knowledge and help maintain strong operational and security standards.

What We’re Looking For

• 5-7+ years of hands-on experience in systems administration, infrastructure/platform operations or technical support, including senior L2/L3 responsibility.

• Advanced practical expertise across Linux, CPU/GPU infrastructure, Kubernetes, virtualisation, storage and networking.

• Experience supporting business-critical AI, HPC, cloud or large-scale data centre environments.

• Proven ability to diagnose complex multi-layer faults and lead incident recovery through to permanent resolution.

• Sound engineering judgement, risk awareness and ownership of complex infrastructure changes.

• Strong communication skills when working with customers, engineers, operations teams and vendors.

• A collaborative approach to mentoring junior engineers, documenting solutions and improving service reliability.

• A proactive interest in automation, operational excellence and next-generation AI infrastructure.

Nice to have:

• NVIDIA infrastructure such as HGX, GB200/GB300, NVLink, NVSwitch and BlueField DPUs; AI/HPC tools such as Slurm, DCGM, NCCL and GPU Operator.

• Distributed storage (VAST Data, WEKA, Lustre, BeeGFS) and networking technologies including Arista, Cisco, Spectrum-X, RoCE and UFM.

• Automation and observability tools such as Ansible, Terraform, Python, MAAS, Ironic, PXE, Redfish, Prometheus, Grafana and OpenTelemetry.

Why Join Sharon AI?

You'll be joining a rapidly growing Australian technology business at an exciting stage of its journey, with the opportunity to work directly with the infrastructure and technology powering the next generation of AI.

🏡 Hybrid working – flexibility between our office and working from home

🎂 Birthday leave – take some extra time to celebrate your day

🧠 Employee Assistance Program (EAP) – confidential support when you need it

🤖 Exposure to AI and next-generation technology – work in one of the fastest-moving areas of technology

🎓 Learning & development – we support your career growth with approved conferences, professional memberships & courses

🚗 Novated leasing – a tax-effective way to finance and run your car

🎁 Bounty referral program – generous rewards for successfully referring new talent to Sharon AI

🏆 Employee of the month – recognition plus a $500 gift card

🌏 Growing global business – be part of an Australian technology company with an expanding international footprint

💡 Make an impact – join at a stage where your work can have a visible influence on how we build and grow

🤝 Collaborative culture – work alongside talented people across technical, commercial and corporate teams

Our Values

Integrity | Innovation | Collaboration | Wellbeing | Inclusion

Apply today and help us build the infrastructure powering the next generation of AI.

Due to the high volume of applications we receive, we’re unfortunately not always able to provide individual feedback to unsuccessful candidates. We appreciate your understanding and want to assure you that every application will be reviewed with care.