aimlroles

Senior AI Engineer, AI Platform

Kharon kharon.com Open · verified Oct 22, 2026
Hybrid New York Full-time Senior ML Platform & Ops

At a glance

Senior ML Platform & Ops role at Kharon. New York · full-time · no salary stated · we estimate $171,375–$247,600.

Estimated pay

Kharon has not published a salary for this role. The figure below is our estimate, not theirs.

$171,375 – $247,600
What the middle half of senior ML platform & ops roles in New York paid, among postings that did state a salary.
Worked out from 15 postings that stated pay, median $211,500. Last updated Oct 21, 2026.
RoleML Platform & Ops
SenioritySenior
LocationNew York
WorkplaceHybrid
EmploymentFull-time
PostedOct 12, 2026 · 10d ago
Role brief

aimlroles summary, based on the employer's posting.

What you'll do

  • Build AI proof-of-concepts quickly, then test them with users and refine the models and interfaces
  • Take AI features from initial design through production, including data flows, code, containers and secure cloud deployment
  • Create production data pipelines and internal tools such as CI/CD scripts, evaluation harnesses and dashboards
  • Work with product, design, engineering and data science partners to turn business problems into scalable AI systems
  • Monitor AI systems and check their explainability, ethics, regulatory alignment and performance

What you bring

  • Strong Python software development skills and experience delivering production-ready AI or ML systems on short iteration cycles
  • Hands-on experience with AI frameworks, including LangChain or LangGraph, agent SDKs and related libraries
  • Experience with tracing, retrieval-augmented generation, memory systems or MCP servers, plus understanding of model tradeoffs
  • Familiarity with Docker and cloud deployment, with AWS preferred

Who this fits

This is a senior, full-time role for someone who can build and ship AI systems through rapid development cycles. You must be based in New York City and work in the office at least three days each week. You’ll collaborate across product, design, engineering and data science.

From the employer

TL;DR Kharon is seeking a full-time Senior AI Engineer based in New York City. This role requires in-office attendance at least 3 days a week.
  • Design, develop, and ship proof-of-concept AI applications within days or weeks. Work in fast, agile cycles to test ideas, gather feedback, and refine models and interfaces.
  • Build and integrate advanced AI components, including Model Context Protocol clients and servers, foundation model fine-tuning, and multi-agent orchestration frameworks (eg. Claude Agent SDK, LangChain, AutoGPTI)
  • Take features from idea to production, including architecting data flows, writing high-quality code, containerizing services, and deploying them in secure cloud environments (e.g., AWS).
  • Partner closely with product managers, designers, engineers, and data scientists to translate abstract business problems into concrete, scalable AI systems.
  • Develop production-grade data pipelines integrating data to/from AI systems.
  • Develop and maintain internal tools to speed up development cycles, CI/CD scripts, evaluation harnesses, dashboards, and secure sandbox environments.
  • Ensure AI systems are monitored, explainable, and aligned with ethical, regulatory, and performance standards.
  • Stay at the forefront of AI/ML advancements, evaluate open-source frameworks, and share best practices across the team.
  • Bachelor's or Master’s degree in Computer Science, Artificial Intelligence, Engineering, or a related field preferred.
  • Strong software development skills in Python and experience with libraries like Langchain/Langgraph, Agent SDKs, Pydantic, SQLAlchemy/Alembic, PySpark/Polars/Pandas.
  • Experience with tracing systems (MLFlow, Sentry), RAG Systems, Memory Systems, MCP Servers, Agent Skills, and knowledge of different models and tradeoffs.
  • Strong understanding of how to make use of AI tools for rapid development (Cursor, Claude Code, etc)
  • Familiarity with containerization (Docker), cloud deployment (AWS preferred, Github Actions)
  • Demonstrated ability to ship high-quality, production-ready ML/AI systems under tight iteration cycles.
  • Passion for solving complex problems with real-world impact, especially in high-stakes or regulated domains.
  • Excellent communication skills and the ability to thrive in cross-functional, mission-driven environments.