Lawrence Jones @lawrencejones.dev · Nov 7

AI is weird: unlike normal code, if you screw up it may valiantly continue, giving convincingly wrong results. Was debugging a prompt intended to shortlist PRs according to a query that was returning random links. Turns out templating was borked & we'd given it no input, so it just made stuff up.

0 likes 2 replies

?

Replies

Ed Stephinson · Nov 7

Need a prompt to check if it’s got everything it needs injected to action correctly. Then we need a prompt to make sure that prompt has everything it needs to function correctly. Then we need

Lawrence Jones · Nov 7

In this case it made up three results that might hypothetically match the query, in the format we'd expect. This is... confusing, if quite funny.