Senior Member of Technical Staff, Applied ML

About the Role

Join an applied ML team building production AI systems for accounting workflows. You will develop reliable agent systems that can reason, plan, use tools, and evaluate their own performance, combining research-minded experimentation with practical software engineering.

What You'll Do

• Design and iterate on multi-agent architectures that automate complex accounting workflows.

• Define agent autonomy boundaries, tool usage, fallback behaviors, and validation layers to support safe, reliable operation.

• Build context and memory systems, and create agent loops with measurable success criteria.

• Route, evaluate, and optimize models for latency, cost, and accuracy.

• Develop scalable offline and online evaluation pipelines to run experiments and compare model performance.

• Define benchmark tasks, labeling strategies, and metrics, then instrument systems to detect regressions and guide improvements.

• Build prompt and retrieval pipelines that turn unstructured documents into useful representations for reasoning.

• Scope projects, implement and test end-to-end systems, and communicate progress and learnings with your team.

What We're Looking For

• At least 3 years of substantive industry AI or ML engineering experience, with senior-level project ownership.

• Strong Python skills and deep familiarity with LLMs, transformers, and machine learning fundamentals.

• Hands-on experience building end-to-end LLM agent applications, including model orchestration, benchmarking, and evaluation of behavior and reliability.

• Experience designing multi-agent systems, retrieval and indexing pipelines, and structured approaches to ML experimentation.

• Experience parsing unstructured documents into structured representations.

• A background in a fast-paced startup, AI-focused company, leading technology organization, hedge fund, or complex software company.

• A strong technical degree in computer science, mathematics, physics, or a related field.

Compensation & Benefits

Annual salary range: $175,000 to $300,000. Visa sponsorship is available.

Location

On-site in New York, NY.