Model Behavior Engineer

About the role

Notion Model Behavior Engineer - non-traditional SWE role focused on prompt/context engineering, LLM evaluation, and model quality strategy for Notion AI products.

Requirements

• Driver mentality, bias to action
• Curiosity about LLM capabilities and AI products
• Analytical instinct, comfortable with data via SQL or coding agents
• Clear communication
• Experience with LLMs, prompting, or AI products

What you'll do

• Design and iterate on system/tool prompts and context strategies
• Debug production data: transcripts, logs, user feedback
• Build eval strategies and datasets, run evaluations, track quality over time
• Evaluate and launch new models from OpenAI, Anthropic, Google
• Manage AI observability/eval tooling such as Braintrust

Where this was posted

• LinkedIn

  last seen 2mo ago
  View on LinkedIn