Eoin Travers

@eointravers.bsky.social

160 Followers 572 Following

Data Scientist @Prolific, serving up human data for the future of AI. Convinced that every problem is a measurement problem. Former cognitive scientist. eointravers.com 🇮🇪

Comic strip from the linked page.

Screenshot of text from the linked article

JSON definition for a node in this graph.

Section of a graph describing the flow of a CBT session.

The Problem
1. A robust evaluation system, tailored to the use case, is crucial to the success of any generative AI-powered product.
2. Most modern AI-powered products, for better or worse, are chatbots, intended to carry out multi-turn conversations.
3. No one has really figured out how to build a good evaluation system for multi-turn conversations.

A placeholder image of a lovely puppy.