Appier

(Senior) Machine Learning Scientist (Modeling & Evaluation)

Appier Taipei, Taiwan

IT Services and IT Consulting · 501-1,000 employees

Oct 07
machine-learning Mid (2-5 yrs) Full-time Taiwan
Create a free account to apply — email only, no card. You can also save this posting or score it against your profile with AI.

About the role

You will design, develop, and deploy optimization solutions using machine learning models while building reliable evaluation methods for LLM outputs. Additionally, you will collaborate with product managers and engineers to translate business needs into technical priorities and validate hypotheses through A/B testing.

What they look for

Machine Learning Modeling Evaluation LLM Statistics A/B Testing Python Classification Regression Ranking Retrieval Causal Inference Embeddings AI-native Development Data Science

Requirements

Candidates must hold a Master's or PhD in a quantitative field and possess at least 2 years of hands-on experience in machine learning or engineering. A strong foundation in statistics, model evaluation, and the ability to drive AI-native development workflows are essential.

Full description

About Appier

Appier (TSE: 4180) is an AI-native Agentic AI as a Service (AaaS) company that empowers businesses to create value through cutting-edge AdTech and MarTech solutions. Founded in 2012 with the vision of “Making AI Easy by Making Software Intelligent,” Appier helps businesses turn AI into ROI through its Ad Cloud, Personalization Cloud, and Data Cloud—each powered by Agentic AI that enables autonomous, adaptive, and real-time decision-making. Today, Appier operates 17 offices across APAC, the US, and EMEA, and is listed on the Tokyo Stock Exchange. Learn more at www.appier.com.

About the Role We are looking for a Machine Learning Scientist (Modeling & Evaluation) to join the Enterprise Solution Science Team and help enterprises turn AI into real ROI. In this role, you will be responsible for end-to-end development, from problem definition to driving models and solutions into production.

What You'll Work On

  • Design, develop, and deploy optimization solutions built on ML models and evaluation, to improve efficiency and quality.
  • Work with PMs and engineers to turn product goals and customer needs into clear problems and priorities, and integrate validated methods into the product.
  • Build reliable evaluation methods for LLM output to measure the quality and impact of solutions, and decide if the results apply to real-world conditions.
  • Form your own hypotheses, then design A/B tests that use real traffic to validate them.
  • Follow the latest research and industry solutions, evaluate them in our own context, and propose new approaches. Decide what to build in-house and what to adopt.
  • Monitor solutions after launch, and proactively communicate risks, trade-offs, and progress.
  • (Optional) Mentor junior scientists and interns, if the need arises.

What We're Looking For (Minimum Qualifications)

  • Master's or PhD degree in Computer Science, Machine Learning, Mathematics, Electrical Engineering, or related fields
  • At least 2 years of experience in machine learning or engineering roles (5+ years preferred)
  • Hands-on experience with ML models (including classification, regression, ranking, and retrieval) and quality evaluation (including LLM-as-a-judge), a solid foundation in statistics, and the ability to explain how these techniques relate to business impact
  • Impact-driven mindset: able to judge task priority, collaborate across functions, and proactively drive work forward and surface risks
  • AI-native development: work daily with coding agents that read the codebase, run tests, and iterate on their own, while you set the scope and review the diffs. Can explain and correct what the agent produced

Preferred Qualifications

  • Experience leading projects
  • Ability to form hypotheses and validate them: design experiments and A/B tests, interpret results, and take ownership of conclusions
  • Background in embeddings and causal inference
  • Engineering experience with AI / LLM applications (for example, serving and integration)

#LI-TC1

Similar roles