Member of Technical Staff Applied ML

Job Description:

Position title: Member of Technical Staff Applied ML

LOCATION: New York NY

WORK MODEL: On site 5 days per week

EMPLOYMENT: Full time

Sponsership: Available including transfers

Base Salary & Equity: Highly competitive

The opportunity is with a rapidly growing, well-funded AI company building intelligent agent systems for complex accounting and finance workflows. This role offers substantial ownership over production ML systems, evaluation infrastructure, and the engineering foundations that help AI agents reason, plan, and improve reliably.

The Opportunity

You will own applied machine learning projects from initial problem definition through production deployment. You will frame hypotheses, define success metrics, run structured experiments, build robust systems, and decide when solutions are ready to ship. The position is designed for an engineer who combines research-minded experimentation with practical product ownership and fast execution.

What You Will Do

Build and Evolve AI Agent Systems

• Design and improve multi-agent architectures that automate real-world accounting and finance workflows.
• Define autonomy boundaries, tool-use patterns, fallback behavior, and safeguards that make agents reliable.
• Manage context and memory across multi-step agent workflows and establish measurable success criteria.
• Route, evaluate, and optimize models for accuracy, latency, reliability, and cost.

Create Evaluation and Experimentation Frameworks

• Build scalable offline and online evaluation pipelines capable of running large experiment suites automatically.
• Develop golden tasks, labeling strategies, benchmarks, and metrics that make agent performance comparable.
• Instrument systems to detect regressions, classify errors, and support continuous improvement.
• Use experiment results and production data to guide product and architecture decisions.

Engineer Context Retrieval and Guardrails

• Architect prompt stacks and instruction hierarchies that structure model behavior.
• Build retrieval and indexing pipelines that surface relevant context efficiently.
• Transform unstructured documents into representations that agents can reason over.
• Design validation and guardrail layers that improve safety, consistency, and determinism.

Own Delivery End to End

• Scope projects, write concise specifications, and produce clear architecture documentation.
• Build, test, deploy, and instrument production systems from first principles.
• Communicate progress, findings, tradeoffs, and next steps with clarity.
• Collaborate closely with engineers and cross-functional partners while sharing knowledge and unblocking teammates.

What We Are Looking For

• Approximately 4 to 12 years of experience as a machine learning engineer or in a closely related applied ML role.
• Hands-on experience building end-to-end LLM-based agent applications, including model orchestration, benchmarking, behavioral evaluation, and reliability testing.
• A record of running structured ML experiments by framing hypotheses, building evaluation infrastructure, measuring outcomes, and iterating based on results.
• Strong product engineering ownership, including taking ML systems from zero to one and operating them in production.
• Experience in a fast-paced startup, a high-performing technology company, or another rigorous engineering environment.
• A bachelor's degree in computer science, mathematics, physics, engineering, or another technical field.
• Clear communication skills and the ability to explain complex technical concepts from first principles.
• Current location in the United States or Canada, with willingness to work from the New York City office five days per week. Relocation may be considered.

Preferred Qualifications

• Deep proficiency in Python and experience with LLM or transformer-based systems.
• Experience building ML products and working with underlying models in a fast-moving organization.
• Familiarity with PostgreSQL, retrieval systems, document processing, and production observability.
• Strong interest in applying AI to accounting, finance, and the broader economy.

Why Consider This Opportunity

• Join a well-capitalized, rapidly scaling company with meaningful runway.
• Work on frontier AI applications with direct responsibility for foundational production systems.
• Operate with significant autonomy and influence technical direction from an early stage.
• Receive competitive compensation and meaningful equity participation.
• Collaborate with a highly accomplished team in a fast-paced, in-person environment.

Equal opportunity employment practices apply. Compensation may vary based on experience, scope, and qualifications.