Senior Linux AI Platform Engineer

About the Company

Proxify – uncovering the world’s hidden talent since 2018. Proxify connects talented tech professionals like you with long-term remote opportunities at top companies in the USA, Sweden, Germany, the Netherlands, and beyond. We believe that talent has no borders and value skills and experience above all else. Since our launch, Proxify has connected over 5,000 talented developers to land their dream remote job at over 1,200 companies.

About the Role

We are looking for a Senior Linux AI Platform Engineer to join one of our largest client teams, a Munich-based technology company building secure, fully on-premises AI solutions for organizations with demanding security, privacy, and data sovereignty requirements. The client is developing an enterprise AI platform that combines modern AI capabilities with secure Linux-based infrastructure, enterprise data integrations, and scalable software services. This is a full-time, long-term engagement. In this role, you will be combining deep Linux systems expertise with strong software development skills and will be working close to the operating system, while also contributing to modern AI-enabled applications. You will be joining a senior engineering team where ownership, technical leadership, and architectural thinking are expected.

Responsibilities

• Design, develop and maintain Linux-based infrastructure powering AI services.
• Build and optimize applications using TypeScript.
• Integrate and operate Large Language Models (LLMs) within production environments.
• Develop and maintain chat-based AI applications and supporting backend services.
• Compile, configure and customize Linux kernels when required.
• Develop Bash scripts for automation, provisioning and operational tooling.
• Improve system reliability, scalability and performance across the platform.
• Work with managed hosting appliances and enterprise infrastructure.
• Maintain backup and disaster recovery solutions.
• Contribute to streaming and distributed systems built around Confluent technologies.
• Troubleshoot issues across the entire software stack, from kernel-level problems to application-level services.
• Participate in architectural discussions and technical decision making.
• Mentor other engineers and help establish engineering best practices.

Qualifications

• 8+ years of professional software engineering experience, with expert knowledge of Linux/Unix systems, including administration, internals, troubleshooting, performance tuning, and operating production environments.
• Experience with Linux kernel configuration, compilation, and preferably kernel development and/or kernel driver development.
• Strong Bash/shell scripting skills for automation, provisioning, and operational tooling.
• Ability to work independently, take ownership of technical solutions, and contribute to architectural decisions.
• Fluent German and strong professional English; willing to travel to Munich, Germany.

Required Skills

• Excellent Python skills, including FastAPI, async/await, and pytest.
• Proven experience with REST API design, OpenAPI, authentication, and backend architecture.
• Solid experience with PostgreSQL, Docker, microservices, and modern TypeScript.
• Experience with distributed systems, including Confluent/Kafka or similar streaming technologies, and designing scalable, reliable, and secure platforms.
• Experience with LLMs, RAG, vector databases, vLLM, LangChain, or AI infrastructure.

Preferred Skills

• Excellent Python skills, including FastAPI, async/await, and pytest.
• Proven experience with REST API design, OpenAPI, authentication, and backend architecture.
• Solid experience with PostgreSQL, Docker, microservices, and modern TypeScript.
• Experience with distributed systems, including Confluent/Kafka or similar streaming technologies, and designing scalable, reliable, and secure platforms.
• Experience with LLMs, RAG, vector databases, vLLM, LangChain, or AI infrastructure.

Why work remotely with Proxify?

• Accelerate your tech career.
• Discover exclusive long-term remote engagements at the world's most interesting product companies.
• Find your dream role.
• Skip the typical recruitment roadblocks and biases with personally matched engagements.
• Gain more freedom. All Proxify roles are 100% remote, no more long commutes and being restricted to the local job market.
• Speedy application. You only need to apply to Proxify once, and, if successful, we’ll recommend you to jobs matching your profile. No more endless edits of your resume!