1 of 311 pain cards, shown in full — score, summary and a real quote from the thread it came from.
We use an LLM to score text records against a checklist, but re-running the same batch changes the pass/fail totals even with temperature at zero.
“re-run the same batch and the totals change (11/27 complete, then 12/27) with nothing changed in the input. One criterion flipping on one record is enough to move the headline number.”
The blurred cards below are placeholders. No locked title, quote, score or id is sent to the browser.
Independent complaints cluster into one recurring pain with quotes from the threads they came from.
“We lose an afternoon every week to this and support keeps telling us it works as intended.”
Several unrelated accounts describe the same failure in the same order of steps.
“I built a script to patch it, but it breaks whenever they change the field names.”
The workaround costs hours a week and depends on a person remembering it.
“Nobody on the team can explain why it only fails for some of our records.”
Independent complaints cluster into one recurring pain with quotes from the threads they came from.
“We lose an afternoon every week to this and support keeps telling us it works as intended.”
Several unrelated accounts describe the same failure in the same order of steps.
“I built a script to patch it, but it breaks whenever they change the field names.”
The workaround costs hours a week and depends on a person remembering it.
“Nobody on the team can explain why it only fails for some of our records.”
Independent complaints cluster into one recurring pain with quotes from the threads they came from.
“We lose an afternoon every week to this and support keeps telling us it works as intended.”
Several unrelated accounts describe the same failure in the same order of steps.
“I built a script to patch it, but it breaks whenever they change the field names.”
The workaround costs hours a week and depends on a person remembering it.
“Nobody on the team can explain why it only fails for some of our records.”
Independent complaints cluster into one recurring pain with quotes from the threads they came from.
“We lose an afternoon every week to this and support keeps telling us it works as intended.”
Several unrelated accounts describe the same failure in the same order of steps.
“I built a script to patch it, but it breaks whenever they change the field names.”
The workaround costs hours a week and depends on a person remembering it.
“Nobody on the team can explain why it only fails for some of our records.”
Independent complaints cluster into one recurring pain with quotes from the threads they came from.
“We lose an afternoon every week to this and support keeps telling us it works as intended.”
Several unrelated accounts describe the same failure in the same order of steps.
“I built a script to patch it, but it breaks whenever they change the field names.”
The workaround costs hours a week and depends on a person remembering it.
“Nobody on the team can explain why it only fails for some of our records.”
Independent complaints cluster into one recurring pain with quotes from the threads they came from.
“We lose an afternoon every week to this and support keeps telling us it works as intended.”
Several unrelated accounts describe the same failure in the same order of steps.
“I built a script to patch it, but it breaks whenever they change the field names.”
The workaround costs hours a week and depends on a person remembering it.
“Nobody on the team can explain why it only fails for some of our records.”
Independent complaints cluster into one recurring pain with quotes from the threads they came from.
“We lose an afternoon every week to this and support keeps telling us it works as intended.”
Several unrelated accounts describe the same failure in the same order of steps.
“I built a script to patch it, but it breaks whenever they change the field names.”
The workaround costs hours a week and depends on a person remembering it.
“Nobody on the team can explain why it only fails for some of our records.”
Independent complaints cluster into one recurring pain with quotes from the threads they came from.
“We lose an afternoon every week to this and support keeps telling us it works as intended.”
Several unrelated accounts describe the same failure in the same order of steps.
“I built a script to patch it, but it breaks whenever they change the field names.”
The workaround costs hours a week and depends on a person remembering it.
“Nobody on the team can explain why it only fails for some of our records.”
Create a free account, then upgrade to Pro to unlock all 311 cards in OpenAI Platform & APIs.
Create free accountAlready have an account? Sign in