Sr. Software Engineer - AI Agent and LLM Applications
At a glance
Senior AI Engineering role at Super Micro Computer. San Jose · $160,000–$200,000 base.
aimlroles summary, based on the employer's posting.
What you'll do
- Build agent systems that handle customer questions about AI servers and racks, including multi-agent or tool-driven designs
- Create the interfaces agents use to call tools, then connect them with ticketing, databases, monitoring, and automation systems
- Improve retrieval-augmented generation and connect the platform to the existing knowledge base
- Set up agent workflows, failure handling, human review, and escalation, with cloud and locally hosted model options
- Work with automation colleagues on reliable tool access, permissions, logging, tracing, and observability
What you bring
- You have at least two years building LLM applications or AI agents
- You have built agents that use tools or coordinate multiple agents, and understand tool invocation and orchestration
- You can implement retrieval systems with vector databases, embeddings, and retrieval tuning
- You bring strong Python skills, API design, system integration experience, and hands-on work with a major LLM API and local models
Who this fits
This senior engineering role suits someone who can build and integrate agent applications and communicate with automation teams and subject-matter experts. The position is based in San Jose.
From the employer
Job Req ID: 30247
About Supermicro:
Supermicro® is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop/ Big Data, Hyperscale, HPC and IoT/Embedded customers worldwide. We are the #5 fastest growing company among the Silicon Valley Top 50 technology firms. Our unprecedented global expansion has provided us with the opportunity to offer a large number of new positions to the technology community. We seek talented, passionate, and committed engineers, technologists, and business leaders to join us.
Job Summary:
We are building an AI Agent–powered platform to handle customer issues related to AI Servers and Racks. The system will interact with customers via chatbot, analyze issue tickets, and generate troubleshooting steps for the on-site service team. This role focuses on the design, implementation, and system integration of the Agent platform.
Essential Duties and Responsibilities:
- Design and implement Multi-Agent or Tool-using Agent systems (using OpenClaw or other agent frameworks)
- Define, develop, and maintain Tools / Function Calling interfaces that agents can invoke
- Integrate with external systems (ticket systems, databases, monitoring data, automation workflows, etc.)
- Build and optimize the RAG pipeline and integrate the existing Knowledge Base
- Support hybrid deployment and switching between cloud models (e.g., Grok) and local models (e.g., Ollama)
- Implement agent execution flows, error handling, human-in-the-loop, and escalation mechanisms
- Collaborate with the Automation team to ensure stable Tool interfaces and proper access control
- Establish basic logging, tracing, and observability
Qualifications:
- Experience in LLM applications or AI Agent development (2+ years of experience is preferred)
- Hands-on experience building Tool-using Agents or Multi-Agent systems
- Familiarity with Function Calling / Tool Use and agent orchestration
- Experience implementing RAG (vector databases, embeddings, retrieval tuning)
- Strong Python skills with API design and system integration experience
- Experience with at least one major LLM API and local model deployment solutions
- Ability to communicate effectively with cross-functional teams (Automation, Domain SMEs)
- Experience integrating with ITSM, technical support, operations, or monitoring systems is a plus
- Hands-on experience with frameworks such as OpenClaw, LangGraph, CrewAI, or AutoGen is a plus
- Experience with agent observability, cost control, or production deployment is a plus
- Experience implementing human-in-the-loop or escalation mechanisms is a plus
Salary Range
$160,000 - $ 200,000
The salary offered will depend on several factors, including your location, level, education, training, specific skills, years of experience, and comparison to other employees already in this role. In addition to a comprehensive benefits package, candidates may be eligible for other forms of compensation, such as participation in bonus and equity award programs.
EEO Statement
Supermicro is an Equal Opportunity Employer and embraces diversity in our employee population. It is the policy of Supermicro to provide equal opportunity to all qualified applicants and employees without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, protected veteran status or special disabled veteran, marital status, pregnancy, genetic information, or any other legally protected status.