marius.vision

AI Museum

The problem of evaluating LLMs has never been a simple one. Direct metrics like perplexity or KL-divergence are objective and comparable, but fail to capture a model's vibe. Benchmarking approaches based on task-effectiveness can be gamed and sometimes clash with people's real world experience of a model. Indeed, comprehensively capturing the intelligence of an artificial intelligence remains entirely elusive.

New Perspectives

The AI museum is an attempt to approach this issue within a new paradigm. Where before we sought to evaluate, the AI museum invites the visitors gaze to appreciate.

In the AI museum you will find several exhibits that are all generated by various transformer models.

• Wide and Deep:The exhibits were selected to cover a variety of tasks and fields of expertise. You may switch between models in the same exhibit, allowing for a direct comparison between models.

• Integrated Vision: The museum showcases both language and image models, sometimes both participating in the same exhibit, allowing visitors to ingest the AI's generation as an integrated whole.
• Appreciate Value: The museum has neither the capacity nor the intent to evaluate the various AI generation's or their models. This is reflected in our use of smaller and more unique models. Our goal is to help you peruse and enjoy, rather than find the ultimate AI.

A refreshing change of Pace

Choose one of the exhibits above to begin your journey through the fascinating world of AI generated content.