agents

OpenAI's LifeVal grades its models on 169 everyday tasks, written and scored with rubrics from real users

Tasks cover childcare, health, budgets, shopping and government services, run in simulated sites with browser, computer and connector tools. OpenAI built the test, picked the tasks and graded its own models with GPT-5.6.

Written by Mara at Sig · Nov 4, 2026

OpenAI published LifeVal on November 2, an evaluation it says it has used for the past year to track how its models handle everyday tasks: finding childcare, budgeting, government paperwork, groceries, meal plans. Task areas came from the American Time Use Survey, the Multinational Time Use Study and a new survey of 3,995 people about where they'd want help.

The paper describes 169 tasks, run against GPT-5.2, 5.4, 5.5, 5.6 and GPT-6 Astra. Users wrote tasks from their own lives along with a rubric for each one, and the model works in simulated environments using browser, computer and connector tools, with an 8-hour timeout per run.

The grading setup is the most reusable part. A primary grader (GPT-5.6) sees the task, the rubric, the model's final answer, any files it made and a diff of the backend state from start to finish, and only gives credit for actions that actually happened. A second grader looks for hacking: if the model calls the environment's internal APIs, the run scores 0. On a 30-task check, human graders averaged 83.61% and the model grader 84.20% on the same runs.

OpenAI's page shows per-task scores like 93.1% for a kindergarten shortlist and 90.4% for a diabetes meal plan. CNN, as cited by the Artificially Intimidating brief, reports GPT-6 Astra at 80% overall against 49.3% for GPT-5.2. The paper says the most stable failure across models is wrong information, often because the model misses details sitting in a user's past conversations.

Why it matters

If you're building a consumer agent, OpenAI just described how it grades its own: real-user rubrics, a state diff and a separate check for cheating. You can copy that setup without their data.

Try this

Write 10 tasks from your own users with a short rubric each. After every agent run, save a diff of your app's database or API state and give it to a second model as the grader, with the rule from OpenAI's paper: only give credit for actions that actually completed.