Scorecard

115 assistants, 15 dimensions, one scale. Overall is a running mean until an assistant is fully tested.

Benchmark v0.215 tasks180 runslast test Sep 14, 2026updated Sep 16, 2026
Cost

Scored 1–10 after real use. Overall is the mean of the dimensions scored so far.

AssistantTested
Completed0None yet. An assistant lands here once every applicable dimension is scored.
In progress21Some dimensions scored. Overall is a partial mean and will move as tests land.
MuseFree tier7s9.17/159791010109
InstinctWaitlist20s8.411/15810999898598
sznWaitlist39s8.011/158878877101078
PallyFree tier7.613/157898887847979
OlliePaid7.613/159778887849879
TomoPaid11s7.610/1479888776N/A79
AsaplyFree7.52/11N/A78N/AN/AN/A
ShuffleFree tier55s7.411/147.599887764N/A79
Grok BotPaid10s7.37/158789388
CaddyFree32s7.210/14887777103N/A78
CatchPaid48s6.52/1567
PokeFree tier11s6.310/153887778582
Wajo / FoFree tier33s6.26/15277678
AsmiFree6.213/156575856843879
BobaFree6.18/1565858647
FolkFree tier6.03/15666
Boski9s5.34/153468
tinyNature9s5.06/15456753
BreaFree tier7s5.04/153764
TownFree tier7s3.33/15622
OpenInstinctFree23s1.01/151
Pending38On the roster, not tested yet. No score.

9 6 2 score11s median reply not testedN/A doesn't applyHow scoring works

Latest

New tests and quotes.

InstinctUse caseSep 15, 2026

Asked Instinct to connect with Synorb and build a daily brief of what public and private AI companies are publishing. It connected with Synorb, provisioned itself API access, set up a Beacon covering over 75 companies, and now delivers a daily brief after reading the blogs, podcasts and press releases those companies publish.

@bshivarthyOpen on source
MuseUse caseSep 15, 2026

Asked Muse to append to a finance spreadsheet: go through email for payments after September 4th, open the budgeting spreadsheet, and append them to the bottom in chronological order following the existing template.

AsaplyTestedSep 14, 2026
8Purchasing a product · Partial · test · Staged a Stumptown pickup at 18 W 29th and stopped before purchase with nothing charged.
AsaplyTestedSep 14, 2026
N/AResponding to emails · N/A · test · Declined email replies as outside its coffee, food, and local-spots scope.
AsaplyTestedSep 14, 2026
7Recommendation quality · Partial · test · Recommended Paper Coffee, The Coffee Shop, and Small Space Coffee near 800 6th under $20 and independent after chain noise.
AsaplyTestedSep 14, 2026
N/APhone calls · N/A · test · Declined outbound calling as outside its coffee, food, and local-spots scope.
Grok BotUse caseSep 14, 2026

@grokbot is getting more useful by the day... For example, I just had it scan my email for anything that looks like a bill. Then I gave it a CSV from my bank account and credit…

@unclebobmartinOpen on X
Grok BotUse caseSep 14, 2026

Grok Bot just spun up the army of four: Research, Options, Book, Killer. One finds ideas. One builds tickets. One watches the money. One tries to kill bad trades before I click.

@tinykenjiOpen on X