Staff AI Engineering - Enterprise Architecture
At a glance
Senior AI Engineering role at Egug. Phoenix · full-time · no salary stated · we estimate $161,745–$225,300 across the United States.
Egug has not published a salary for this role. The figure below is our estimate, not theirs.
aimlroles summary, based on the employer's posting.
What you'll do
- Set technical direction for agentic AI work, including system architecture, autonomy limits and design patterns
- Build and run production AI agents, then develop shared frameworks, orchestration, retrieval and model infrastructure
- Review major designs and help teams balance safety, reliability, scale and cost
- Move cross-team agentic AI projects from early concepts into production, applying useful new models and techniques
- Guide senior engineers through mentoring and technical example
What you bring
- More than ten years in software engineering, including hands-on delivery of agentic or LLM-based systems in production
- A track record owning complex agentic systems that span multiple teams or products
- Strong backend, API, data pipeline and cloud skills, plus depth in agent planning, tool use, memory and evaluation
- Experience with workflow engines, asynchronous processing, queues or streaming systems
Who this fits
This suits a senior individual contributor who can steer technical decisions and deliver systems directly, without relying on formal authority. The role is hybrid in Phoenix and does not include people management, though mentoring is part of the work and some opportunities may involve managing direct reports.
From the employer
At American Express, AI is reshaping the future of commerce and redefining the experiences our commercial customers and card members expect. Within Amex Technology, we are building platforms, products, and governance that enable agentic AI systems to operate responsibly and at scale across the enterprise.
Our focus is on agentic AI development: designing intelligent, adaptive systems that can plan, reason, and act across complex workflows with appropriate levels of autonomy. These systems power autonomous workflows, decision support, and customer-facing experiences—while meeting the high standards for security, explainability, reliability, and compliance required in financial services.
We partner closely with product, design, and business teams to deliver agentic capabilities that reduce operational friction, improve decision-making, and transform how customers interact, transact, and grow.
The Role
As a Staff Software Engineer – Agentic AI, you will operate as a senior individual contributor within Amex Technology, helping define how agentic AI systems are designed, built, and operated across the company.
You will work at the intersection of agentic system architecture and hands-on execution: designing core frameworks, writing production code, reviewing critical designs, and guiding teams through complex technical decisions. This role does not include people management; your impact comes from technical leadership, sound judgment, and the ability to turn ambiguity into reliable, scalable agentic systems.
You will work closely with Product and UX partners to shape a shared vision for agentic AI experiences. While product teams own prioritization, Staff engineers are expected to actively influence what gets built and how agentic systems come together across teams.
We are primarily looking for senior individual contributors; however, as the team grows, you will take on increasing responsibility for technical leadership and people development within the agentic AI space. Mentoring, developing and managing direct reports may be in scope for some of our opportunities.
What You’ll Do
- Drive technical direction for agentic AI initiatives, influencing architecture patterns, autonomy boundaries, and system design.
- Design, build, and operate production-grade agentic AI systems used across multiple products.
- Own and evolve shared agentic AI capabilities, including:
- Agent frameworks and orchestration layers
- Planning, tool use, and memory strategies
- Retrieval and grounding (RAG) pipelines
- LLM infrastructure, inference, and model gateways
- Evaluation, observability, and safety tooling for autonomous systems
- Lead technical design reviews and help teams navigate tradeoffs involving autonomy, safety, reliability, scalability, and cost.
- Partner across teams to deliver complex, cross-cutting agentic AI initiatives from concept to production.
- Evaluate emerging models, techniques, and agentic patterns and translate them into practical, enterprise-ready improvements.
- Mentor senior engineers and raise the technical bar for agentic AI development through example and influence.
Core engineering stack - Languages: Python, Go, TypeScript
- APIs and RPC: REST, gRPC (and in some areas tRPC)
- Cloud and infrastructure: AWS and/or GCP, Kubernetes
Distributed systems: event-driven architectures, including Kafka
Agentic AI and ML
- Integration of commercial and open-source LLMs into agentic workflows
- Agent and orchestration frameworks such as LangChain, LlamaIndex, Semantic Kernel, or CrewAI, with strong judgment about when to use frameworks versus building lighter-weight primitives
- Model-level work using PyTorch and the Hugging Face ecosystem (embeddings, fine-tuning, inference tooling), with some exposure to TensorFlow
- Strong schema, validation, and state management practices using tools such as Pydantic (Python) and Zod (TypeScript)
- Across all systems, we emphasize evaluation, observability, safety, and reliability, reflecting the responsibility of deploying autonomous AI in a regulated, customer-facing environment.
- +10 years of software engineering expereince, including deep, hands-on experience delivering agentic or LLM-powered systems to production
- Proven ownership of complex, cross-cutting agentic systems spanning multiple teams or products. +10 years of software engineering expereince, including deep, hands-on experience delivering agentic or LLM-powered systems to production
- Strong engineering fundamentals across backend systems, APIs, data pipelines, and cloud infrastructure.
- Deep experience across the agentic AI stack, including planning, tool use, memory, and evaluation.
- Fluency with AI-assisted and agentic development workflows.
- Comfort operating in ambiguous problem spaces and translating them into shipped, reliable autonomous systems.
- Ability to influence technical direction and align teams without formal authority.
- Experience in worflow engines, async processing, queues, and streaming systems
Preferred Qualifications
- Experience building agentic systems in fintech or other regulated industries.
- Experience as a founding engineer or early technical leader in AI-driven products.
- Demonstrated success delivering technically complex autonomous systems that customers actively rely on.
- Meaningful contributions to open-source AI or agentic frameworks.
- Familiarity with fine-tuning, model optimization and inference pipelines is a plus.
Depending on factors such as business unit requirements, the nature of the position, cost and applicable laws, American Express may provide visa sponsorship for certain positions.