Opportunity ML Platform & Ops work from LinkedIn, X, Reddit and Upwork, in one list. Find me work
aimlroles

Staff Backend AI Platform Engineer

Freshworks freshworks.com Open · verified Nov 21, 2026
Hybrid San Mateo Full-time Senior ML Platform & Ops

At a glance

Senior ML Platform & Ops role at Freshworks. San Mateo · full-time · $225,000–$278,000 base.

SalaryStated by Freshworks
$225,000 – $278,000
Base salary for this role, in USD per year, as published in the posting.
This role, from FreshworksOur estimate for the market: $220,000–$320,145Median $251,500
The range includes the market median of $251,500 for senior ML platform & ops roles in San Mateo.
Worked out from 5 postings that stated pay, median $251,500. Last updated Oct 29, 2026.
RoleML Platform & Ops
SenioritySenior
LocationSan Mateo
WorkplaceHybrid
EmploymentFull-time
Base pay$225,000–$278,000
PostedNov 18, 2026 · 3d ago
Role brief

aimlroles summary, based on the employer's posting.

What you'll do

  • Lead backend runtime services that let AI agents reason, plan tasks and call tools
  • Build APIs and SDKs for teams to create and launch agent workflows
  • Develop dialog state and memory services for agents that retain context across turns
  • Connect agents through shared context and communication protocols, and build RAG data pipelines
  • Improve orchestration speed and cost, while adding security, testing and observability across services

What you bring

  • At least six years building backend systems, including one or more years developing AI/ML platforms
  • Strong Java and Python skills, with practical work using LangChain, LangGraph or LangSmith
  • Deep knowledge of event-driven systems, microservices and Kubernetes
  • Experience with AWS, Terraform, PostgreSQL and vector databases, plus workflow engines and Kafka

Who this fits

This senior, hands-on technical lead role suits someone who can turn architecture into scalable agent platform services and guide junior engineers. You’ll work on site in San Mateo Tuesday through Thursday each week.

From the employer

Software should help a business move as one. But too often, disconnected systems, scattered data, and fragmented workflows get in the way.

Freshworks is building a better way: AI-powered, unified service operations that turn complexity into coordinated action. Our platform brings together people, AI, data, and workflows so IT and service teams can anticipate what matters, act faster, and keep the business moving forward together. Organizations including Bridgestone, McLaren, New Balance, S&P Global, and Sony Music trust Freshworks to power the services their employees and customers depend on every day.

We bring that same belief in coordinated action to how we work by giving people the ownership to make bold moves at speed, and a team that moves with them.

We are seeking a Backend AI Platform Engineer to lead the development of core backend services powering our Agentic AI Platform. In this role, you will be the primary technical driver for building reasoning-driven agents, multi-agent orchestration, and outcome-based workflows.

You will collaborate with the Principal AI Architect to bridge the gap between high-level design and scalable implementation. You will own the development of high-performance APIs and orchestration runtimes, integrating frameworks like LangChain, LangGraph, and LangSmith. This role is highly hands-on and requires a technical leader who can navigate a fast-paced environment while maintaining high engineering standards.

Key Responsibilities

Platform Backend Development

  • Lead Implementation: Act as the lead engineer for agent runtime orchestration services, focusing on reasoning, planning, and tool invocation.
  • API & SDK Design: Own the development of robust APIs and SDKs that enable internal and external teams to build and deploy agent workflows.
  • State & Memory Management: Build and optimize stateful dialog management and memory services for multi-turn, context-aware agents.
  • Agent Communication: Implement multi-agent communication (A2A) protocols and shared context systems.

System Architecture & Execution

  • Microservices Leadership: Execute the transition to cloud-native, event-driven backend services using microservices or service mesh architectures.
  • Workflow Design: Build and manage task scheduling and long-running operations using tools like Temporal or Airflow.
  • Performance Optimization: Optimize LLM orchestration for performance and cost through caching, batching, and token monitoring.

Integrations & Data Services

  • Data Pipeline Ownership: Implement and maintain RAG pipelines and integrations with vector databases (e.g., Pinecone, Weaviate, FAISS).
  • Telemetry Integration: Ensure all backend services support LangSmith-based evaluation and comprehensive observability.

Security & Reliability

  • Tenant Isolation: Implement RBAC, API authentication, and multi-tenant isolation logic.
  • Engineering Excellence: Set the standard for automated testing (unit, integration, load) and implement OpenTelemetry for full system visibility.
  • Mentorship: Provide technical guidance and code reviews for more junior backend engineers on the team.

Required Qualifications:

  • 6+ years of backend engineering experience.
  • 1-2+ years of hands-on experience in AI/ML platform development.
  • Expert Proficiency: Strong programming skills in Java and Python.
  • Framework Expertise: Hands-on experience with LangChain, LangGraph, or LangSmith.
  • Distributed Systems: Deep understanding of event-driven architectures, microservices, and Kubernetes.
  • Cloud & Data: Solid experience with AWS, Terraform, and a mix of relational (PostgreSQL) and Vector databases.
  • Orchestration: Practical experience with workflow engines like Temporal or Airflow and messaging systems like Kafka.

Preferred Qualifications:

  • Experience with AI-driven planning systems or dialog state tracking.
  • Background in enterprise security (RBAC, SSO, OAuth2).
  • Experience working in a high-growth SaaS or startup environment.
  • Active contributions to open-source backend or AI frameworks.

Please note this is a hybrid role with onsite expectations of 3x/week (Tues - Thurs) from our San Mateo, CA headquarters.

The annual base salary range for this position is $225,000- $278,000. This role is also eligible for a target bonus.

Compensation is based on a variety of factors, including but not limited to location, experience, job-related skills, and level.

Freshworks offers multiple options for dental, medical, vision, disability, and life insurance. Equity + ESPP, flexible PTO, flexible spending, commuter benefits, and wellness benefits are also offered. Freshworks also offers adoption and parental leave benefits.

At Freshworks, we have fostered an environment that enables everyone to find their true potential, purpose, and passion, welcoming colleagues of all backgrounds, genders, sexual orientations, religions, and ethnicities. We are committed to providing equal opportunity and believe that diversity in the workplace creates a more vibrant, richer environment that boosts the goals of our employees, communities, and business. Fresh vision. Real impact. Come build it with us.

Opportunity

ML Platform & Ops work from LinkedIn, X, Reddit and Upwork, in one list.

Each morning you get everything that fits, strongest first.

ML Platform & Ops$220k+

Find me work

By the team behind aimlroles.

Find me work
Opportunity

ML Platform & Ops work from LinkedIn, X, Reddit and Upwork, in one list.

Each morning you get everything that fits, strongest first.

Find me work

By the team behind aimlroles.