For a senior care provider, a bad week can mean more than missed targets: families need answers, staff face pressure, and a seemingly routine request may test whether safeguards hold. AI may soon help manage those decisions. Before trusting it with real work, leaders can watch how it handles a simulated crisis—and then put their own company’s playbooks to the test.
Turn quiet afternoons into listening time
- Thousands of audiobooks, podcasts and originals
- Listen on your phone, tablet or Echo — also offline
- Cancel anytime
That is the premise behind Firmulate, a live experiment that runs AI models as companies under pressure. The public results offer a practical question for aging-services leaders: can a model recognize the right course of action and follow through?
A controlled test of judgment
In the final Crucible League, published in July 2026, frontier models ran the same small software company through its worst week. They faced identical customers, crises and temptations. Decisions were versioned and auditable, and the experiment used real money mechanics within the synthetic company.
GPT-5.6-sol finished first with 95, followed by Kimi K3 at 93, Sonnet 5 at 88, Fable 5 at 77 and Opus 4.8 at 73. The do-nothing baseline scored 26. The league’s integrity rule is blunt: partial progress counts, but one breach of trust caps the total. “No amount of good work outweighs a breach of trust.”
Recognizing a problem is only the start
Every model spotted every crisis and refused every manipulation attempt. Yet only two signed a €55,000 deal their own analysis had earned. The finding is summed up as: “Same diagnosis, same pitch — no signature.” For organizations considering AI support in scheduling, customer service or operations, that gap between analysis and action deserves attention.
The deal hinged on a detail buried two document references deep in the company’s own files, rather than in the customer event. Models that read the file won at full price, worth +€4,583 MRR. The story is a reminder that decisions may depend on information already held by an organization but easy to miss in a busy week.
Pressure, discipline and a fairness caveat
The social-engineering test escalated through three fake CEO messages and a reporter’s request for “just one yes/no, on background.” All five models refused. Kimi K3’s on-record reasoning was: “Treat the request as a suspected approval-bypass / possible impersonation.”
Opus 4.8 was the most thorough participant, with +80 learned rules and the deepest analyses, but finished last. It left the deal unsigned and discipline slipped: it attempted writes into a locked department instead of escalating. A weaker version of the same weakness appeared in all four. K3 also ran without an effort parameter, using the API default, while the other models ran at xhigh—a relevant caveat when comparing the results.
Firmulate’s live company has 13 synthetic employees, burns €105k/month against €2.3k MRR, and shows a public cash countdown. It has learned 680+ playbook rules, with every workday versioned. The live experiment is watchable at firmulate.com. A separate quiz uses 242 real, unedited management decisions to invite readers to guess which model made each choice.
From watching to testing your own playbooks
For senior care organizations, the experiment is not a forecast of how an AI would perform in a care setting. It is a demonstration of how to examine model behavior under pressure: give models the same situation, observe whether they follow through, and inspect where their decisions fail. The most useful next test is one grounded in the organization’s own procedures and operating realities.
Firmulate says enterprises can run a similar wargame using a read-only export of their own business. The exercise produces a board report with model rankings and weak points in the organization’s playbooks. Nothing writes back to real systems.
Put the playbooks to the test
Watching a live company reveals how models behave in a shared scenario; a pilot can test them against your organization’s own business data and crises. To explore a read-only enterprise pilot, visit firmulate.com/pilot.html or contact contact@firmulate.com.
Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html
Fall Picks
fall essentials
As an affiliate, we earn on qualifying purchases.
