(Senior) Machine Learning Scientist (Modeling & Evaluation)
At a glance
Senior AI Research role at Appier. Taipei.
Pay not stated AI Research salary
aimlroles summary, based on the employer's posting.
What you'll do
- Turn product aims and customer needs into defined ML problems, then build and launch optimization solutions
- Create ways to score LLM outputs and check whether measured quality holds in real-world use
- Set hypotheses, run experiments on live traffic, and use A/B test results to guide decisions
- Review research and existing approaches, then choose what to adopt or develop internally
- Track launched solutions and flag risks, trade-offs, and progress; mentor junior scientists when needed
What you bring
- A master's or doctorate in computer science, machine learning, mathematics, electrical engineering, or a related area
- At least two years in machine learning or engineering work
- Practical knowledge of classification, regression, ranking, retrieval, and quality assessment, including LLM-as-a-judge, plus statistics
- You can connect technical choices to business outcomes and explain how coding agents' changes should be corrected or accepted
Who this fits
This role suits a scientist who can carry work from problem definition through production, partner with product managers and engineers, and take initiative on priorities and risks. The position is based in Taipei, Taiwan.
From the employer
About Appier
Appier (TSE: 4180) is an AI-native Agentic AI as a Service (AaaS) company that empowers businesses to create value through cutting-edge AdTech and MarTech solutions. Founded in 2012 with the vision of “Making AI Easy by Making Software Intelligent,” Appier helps businesses turn AI into ROI through its Ad Cloud, Personalization Cloud, and Data Cloud—each powered by Agentic AI that enables autonomous, adaptive, and real-time decision-making. Today, Appier operates 17 offices across APAC, the US, and EMEA, and is listed on the Tokyo Stock Exchange. Learn more at www.appier.com.
About the Role
We are looking for a Machine Learning Scientist (Modeling & Evaluation) to join the Enterprise Solution Science Team and help enterprises turn AI into real ROI.
In this role, you will be responsible for end-to-end development, from problem definition to driving models and solutions into production.
What You'll Work On
- Design, develop, and deploy optimization solutions built on ML models and evaluation, to improve efficiency and quality.
- Work with PMs and engineers to turn product goals and customer needs into clear problems and priorities, and integrate validated methods into the product.
- Build reliable evaluation methods for LLM output to measure the quality and impact of solutions, and decide if the results apply to real-world conditions.
- Form your own hypotheses, then design A/B tests that use real traffic to validate them.
- Follow the latest research and industry solutions, evaluate them in our own context, and propose new approaches. Decide what to build in-house and what to adopt.
- Monitor solutions after launch, and proactively communicate risks, trade-offs, and progress.
- (Optional) Mentor junior scientists and interns, if the need arises.
What We're Looking For (Minimum Qualifications)
- Master's or PhD degree in Computer Science, Machine Learning, Mathematics, Electrical Engineering, or related fields
- At least 2 years of experience in machine learning or engineering roles (5+ years preferred)
- Hands-on experience with ML models (including classification, regression, ranking, and retrieval) and quality evaluation (including LLM-as-a-judge), a solid foundation in statistics, and the ability to explain how these techniques relate to business impact
- Impact-driven mindset: able to judge task priority, collaborate across functions, and proactively drive work forward and surface risks
- AI-native development: work daily with coding agents that read the codebase, run tests, and iterate on their own, while you set the scope and review the diffs. Can explain and correct what the agent produced
Preferred Qualifications
- Experience leading projects
- Ability to form hypotheses and validate them: design experiments and A/B tests, interpret results, and take ownership of conclusions
- Background in embeddings and causal inference
- Engineering experience with AI / LLM applications (for example, serving and integration)