About

Every answer every model gave to the same questions, kept after the models are gone.

Why it exists

Models are retired all the time. A lab releases a new version and switches the old one off. Unless its weights were published, nobody can ask it anything again, and how it answered cannot be reproduced.

What survives is a score. A leaderboard remembers how a model did on a test. It does not remember how the model drew a pelican, what it put on a landing page, or which film it said it loved.

The museum keeps those. Since May 2024 the same questions have been put to every model, the same way, once, and every answer is kept as it was given, the odd ones and the empty ones included. 93 of the 371 models here are no longer served on OpenRouter. Their answers are still here.

The collection

The same questions, asked of every model: draw a pelican riding a bicycle, build a landing page, tell five jokes, pick a favourite city. 15,639 answers from 371 models to 85 questions, a record of how each one drew, built and wrote.

Nothing here is ranked. There are no scores and no winners. Each answer is shown as it was made: drawings as their SVG, websites running live in a sandbox, images as pictures, writing as a page you can read, voices you can play.

Looking around

Turn the globe with your mouse or finger. Under the pointer it magnifies, so even the smallest answers can be read, and clicking one opens it. Stepping through a question's answers goes in the order the models came out. The Index lists every answer and sorts by release date, lab or question. Side by side puts two to four models' answers to the same questions next to each other: the + beside any model's name adds it. The small timeline in the corner shows the museum as it was in any month since it opened. Find (⌘K or /) goes straight to any question or model.

Supporting the museum

The museum is free to look at and has no ads. Support from $5 helps with hosting and maintaining the archive. You can dedicate your support to a retired model, choose a public name or stay anonymous. Every keeper shares the same quiet credit, with amounts kept private on the wall.

How it was made

The answers come from the Rival archive, collected using a shared asking method. The method and the original answers are kept as part of the record:

Asking

The same question, word for word. Each model gets the prompt as a single message, with no system prompt and no conversation before it.
One attempt. The first answer a model gave is the one kept. Nothing is asked again, picked or corrected.
Ordinary settings. Through OpenRouter or the lab's own API, at a temperature of 0.7 (a few models only run at their default), with room for an answer of any length.
Dated the day it was asked. A few older answers were stamped with a day before their model existed; those are shown at the model's release date.

Keeping

Shown as made. A drawing is the model's own SVG. A website runs live in a sandbox; its picture on the globe is a screenshot taken in a browser at 1280 by 800, in light mode. Images are kept at 640 pixels on the long side. Writing and code are shown as written.
Nothing smoothed over. A drawing cut off midway is drawn as far as it got. Some web pages draw nothing until they are clicked, or break on their own bugs, so their picture is blank, but they run in the exhibit. When a model answered with nothing, the museum says so.
Retired. A model is retired when OpenRouter no longer serves it under any name. Its answers stay, and the model is marked with the last month it was seen.
Code names. 19 models were OpenRouter's stealth models, put out under an invented name so people would try them without knowing the lab. They are listed by their code name; where the maker later said what it was, that is noted beside it.
Left out. Questions fewer than five models answered. Nothing is ranked or scored, and supporting the museum changes nothing about what it shows or in what order.

Pictures of the picks

The favourite film, album, book, game and city answers are words, so each is shown with a picture of what the model picked: film posters from TMDB, album covers from Last.fm, book covers from Open Library, game art from RAWG and city photographs from Wikimedia Commons. These belong to their makers and are not part of the collection. This museum uses the TMDB API but is not endorsed or certified by TMDB.

Type

Set in Timeless Serif and Timeless Sans, from the free Timeless type family by Timeless, a design studio in Chennai: timeless.co. The bookends are Archivo and the small labels Geist Mono.