GenAI / Agentic Architect
At a glance
Mid-level AI Engineering role at Fa Ewjt Saasfaprod1. United States · full-time · $200,000–$280,000 base.
aimlroles summary, based on the employer's posting.
What you'll do
- Set multi-year AI plans by weighing architecture choices across the LLM stack, including cost, speed and privacy trade-offs
- Approve high-level AI designs and choose ingestion patterns such as semantic RAG, Agentic RAG or GraphRAG
- Build LLM monitoring that tracks token use, agent reasoning paths, model drift and hallucinations in production
- Protect sensitive information with DLP, pre-API data sanitization and semantic caching
- Lead client architecture work and explain technical decisions to executives through financial and operational ROI cases
What you bring
- A master's degree in computer science, AI or IT management is required
- Twelve to eighteen years of IT or AI work, with substantial senior architecture and client delivery experience
- Strong technology consulting, solution scoping and proposal design experience
- Deep knowledge of enterprise integration patterns and the ability to assess orchestration, execution and vector-storage options
Who this fits
This role suits a senior architect who can guide client leaders, make enterprise AI design decisions and lead large onshore engagements. The stated experience range is twelve to eighteen years, and the role requires a master's degree.
From the employer
Direct the enterprise GenAI technology portfolio and lead large-scale, onshore client engagements.
Act as a trusted senior technical architect and advisor to client leadership, bridging the gap between cutting-edge AI capabilities and core business transformation.
Oversee multiple architectural delivery streams, making high-impact decisions on technology stacks, framework selection, and infrastructural trade-offs across the 7-layer AI stack.
- Enterprise AI Strategy & Trade-Off Analysis: Define multi-year GenAI roadmaps by evaluating structural architecture trade-offs across the 7-layer LLM stack. Compare Commercial APIs (e.g., GPT-4o, Claude 3.5 Sonnet) vs. Hosted Open-Source LLMs (e.g., Llama 3) based on cost, latency, and data privacy.
- Advanced Architecture Oversight: Review and approve macro-level AI architectures. Architect scalable data ingestion pipelines, selecting between standard semantic RAG, Agentic RAG, or GraphRAG depending on enterprise complexity.
- Advanced Observability & Monitoring: Design deeply integrated AI observability (OBS) layers tailored for LLMs. Implement specialized tools (e.g., LangSmith, Phoenix, Arize) to track token consumption, trace complex agentic reasoning loops, and monitor model drift and hallucination rates in production.
- Robust Data Protection Strategy: Architect comprehensive data protection pipelines utilizing Enterprise Data Loss Prevention (DLP) tools. Ensure data is sanitized before hitting external APIs and implement robust semantic caching to prevent sensitive data leakage.
- Executive Consulting & Technical Pitching: Lead onshore client-facing engagements, pitching complex AI solutions to C-suite stakeholders, translating engineering trade-offs into clear financial and operational ROI frameworks.
- Consulting Skills: High-impact executive presence; extensive experience in technology consulting, solution scoping, and technical proposal architecture.
- Senior Technical Architecture Mastery: Deep hands-on background in enterprise integration patterns. Expert-level capability in comparing orchestration layers (e.g., LangChain vs. LlamaIndex vs. Semantic Kernel) and evaluating modern execution environments (vLLM, TensorRT-LLM).
- Cloud & Vector Strategy: Deep familiarity with dictating enterprise data storage choices by comparing managed vector services (Pinecone) vs. distributed open-source engines (Milvus/Qdrant) or extending existing relational systems (pgvector).
- Qualifications: Master’s in computer science, AI, or IT Management; 12–18 years of progressive IT/AI experience, heavily indexing on senior technical architecture and client delivery.
The typical base pay range for this role across the U.S. is USD $200,000 - $280,000 per year.
For more information on benefits and what we offer please visit us at https://www.exlservice.com/us-careers-and-benefits
The posted range is the hiring range for this role — a subset of the broader range available to employees over time — and reflects base salary across our national hiring scale.
Final offers are based on several factors, including the candidate's skills and experience, internal pay equity, work location, market conditions for the role, and the specific scope and responsibilities of the position.
The top of the range is reserved for candidates who notably exceed the requirements; the lower end applies to those with less experience or fewer preferred qualifications. For positions based in higher-cost zones (e.g., California, New York, New Jersey), actual compensation may exceed the posted range; your recruiter will share specifics during the process.