Prompt Engineer (LLM Systems, Evals & Safety)
At a glance
Mid-level AI Engineering role at webook.com. Remote, Jordan.
Pay not stated AI Engineering salary
aimlroles summary, based on the employer's posting.
What you'll do
- Write and refine system, tool and policy prompts for different tasks, then connect them into chains
- Set up offline and live tests using scoring guides, reference sets and performance measures
- Maintain prompt versions and libraries, run A/B comparisons and track telemetry
- Limit hallucinations with verification, constrained decoding and tool use, while testing jailbreaks and handling PII
- Work with engineers to bring prompts into production features
What you bring
- You have designed prompts for more than one kind of task and model
- You have built evaluation datasets and automated scoring for measures such as accuracy, faithfulness or cost
- You understand retrieval-augmented generation and tool or function calling
- You can use Python or TypeScript to prepare data, run evaluations and analyze results
Who this fits
This role suits a mid-level AI engineer who can turn business goals into measurable prompt specifications and write clearly. The position is based remotely in Amman, Jordan.
From the employer
Do you want to love what you do at work? Do you want to make a difference, an impact, and transform peoples lives? Do you want to work with a team that believes in disrupting the normal, boring, and average?
If yes, then this is the job you are looking for , webook.com is Saudi’s #1 event ticketing and experience booking platform in terms of technology, features, agility, revenue serving some of the largest mega events in the Kingdom surpassing over 2 billion in sales.
Role Overview
Design high-quality prompts, system instructions, and tooling that make our LLM features accurate, safe, and cost-effective. You’ll own evaluation, prompt versioning, and continuous improvement.
Key Responsibilities:
- Author, refactor, and chain prompts (system/tool/policy) for varied tasks.
- Create offline/online evaluation harnesses (rubrics, golden sets, metrics).
- Build prompt libraries with versioning, A/B testing, and telemetry.
- Reduce hallucinations via verification, constrained decoding, and tool use.
- Implement safety: jailbreak/prompt-injection tests, content policy checks, PII handling.
- Partner with engineers to integrate prompts into production features.
Requirements
- Demonstrated prompt design across multiple task types and models.
- Experience building eval datasets and automated scoring (e.g., accuracy, faithfulness, utility, cost/latency).
- Familiarity with retrieval-augmented generation concepts and tool/function calling.
- Strong scripting (Python/TypeScript) for data prep, evals, and analysis.
- Clear writing; ability to translate business goals into measurable prompt specs.
Nice-to-Haves
- Experience with LangChain/LLM orchestration, vector stores, and rerankers.
- Knowledge of safety tooling and red-teaming techniques.
- Experiment platforms (feature flags, A/B tests), analytics.