Generative AI Developer - Senior Associate
At a glance
Senior AI Engineering role at Pwc (Crm Experienced Careers Site). Pune · full-time.
Pay not stated AI Engineering salary
aimlroles summary, based on the employer's posting.
What you'll do
- Build and maintain LLM applications for tasks such as summarizing, classification, question answering and content creation
- Coordinate multiple AI agents, including how they exchange information, assign tasks and use tools
- Create retrieval workflows that prepare text chunks, generate embeddings and search vector stores for relevant context
- Test model quality, safety and factual grounding, then track measures such as coherence and hallucination rates
- Monitor token costs and model behavior, and refine prompts, retrieval and memory for better performance
What you bring
- At least five years of IT experience, including two to three years developing AI, machine learning or generative AI systems
- You have built, tested and deployed LLM or agent-based applications in production or pilot environments
- Strong Python skills and experience with LangChain, LlamaIndex, CrewAI and LangGraph
- You understand LLMs, tokenization, embeddings and vector databases, and have used evaluation frameworks such as TruLens or LangSmith
- You have experience with MLOps or LLMOps and exposure to a major cloud AI platform
Who this fits
This senior associate role suits a hands-on developer who can take generative AI applications from design through testing and deployment. You’ll work with architects, data scientists, UI/UX engineers and product managers. The role is based in Pune, India.
From the employer
Industry/Sector
Not ApplicableSpecialism
OracleManagement Level
Senior AssociateJob Description & Summary
Job Title: Senior Associate – Generative AI Developer
Experience:
5+ years of total IT experience, including 2–3 years in AI/ML or Generative AI development. Must have hands-on experience building, testing, and deploying LLM-based or agentic AI applications in production or pilot settings.
Role Overview:
The Senior Associate – Generative AI Developer will design, develop, and rigorously test end-to-end Generative AI and agentic AI applications. This role requires hands-on expertise with LLM APIs, RAG pipelines, prompt engineering, and multi-agent frameworks, combined with a disciplined approach to testing, performance monitoring, and optimization.
Key Responsibilities:
- LLM & GenAI Development:
Design, develop, and maintain LLM-powered applications using APIs such as OpenAI, Azure OpenAI, Anthropic, or Cohere. Implement core GenAI workflows including summarization, classification, Q&A, and content generation. - Agentic AI Implementation:
Build and orchestrate multi-agent systems using frameworks like CrewAI, LangGraph, OpenAI Agents SDK, or Azure AI Agent Framework. Implement inter-agent communication, task routing, and tool orchestration for complex workflows. - RAG & Embedding Pipelines:
Implement retrieval-augmented generation pipelines involving embedding creation, chunking, and vector indexing using FAISS, Pinecone, Chroma, or Milvus. Ensure efficient retrieval for context-aware outputs. - Prompt Engineering & Techniques:
Apply advanced prompting strategies such as Few-Shot Learning, Chain-of-Thought (CoT), ReAct, and CART to improve reliability and interpretability of model responses. - Testing & Validation:
Establish automated and manual testing pipelines using TruLens, LangSmith, PromptLayer, or DeepEval to evaluate model quality, accuracy, safety, and factual grounding.
Define and track metrics such as coherence, hallucination rate, and response diversity. - Performance Monitoring & Optimization:
Implement cost-effective token management and model observability using logging and tracing frameworks. Continuously optimize prompts, retrieval logic, and memory mechanisms to improve efficiency. - Data Analysis & Preparation:
Conduct EDA and pre-processing of textual datasets to ensure quality input for training, evaluation, and fine-tuning tasks. - Documentation & Collaboration:
Create detailed design documents, maintain experiment logs, and collaborate with architects, data scientists, UI/UX engineers, and product managers to ensure solution alignment with business goals. - Continuous Learning:
Stay up to date with new model releases (OpenAI GPT, Claude, Gemini, Mistral, LLaMA, etc.) and frameworks in the GenAI and agentic AI ecosystem.
Key Skills & Competencies:
- Strong proficiency in Python, LangChain, LlamaIndex, CrewAI, and LangGraph
- Deep understanding of LLM architectures, tokenization, embedding models, and vector databases
- Experience with prompt testing and evaluation frameworks (TruLens, LangSmith, PromptLayer, DeepEval)
- Familiarity with bias mitigation, safety testing, and Responsible AI principles
- Knowledge of MLOps/LLMOps practices for deploying and monitoring AI models
- Strong analytical mindset, documentation discipline, and collaborative approach
- Exposure to at least one major cloud AI platform (Azure, AWS, GCP, or OCI)
Preferred Background:
- Prior experience in building chatbots, intelligent assistants, summarizers, or document automation solutions using LLMs
- Familiarity with open-weight model experimentation (LLaMA, Mistral, Falcon, etc.)
- Exposure to multi-modal AI (text, image, code) and integration with enterprise data sources
- Experience supporting GenAI projects through testing, benchmarking, and performance optimization
Travel Requirements
Not SpecifiedJob Posting End Date