Here are my detailed notes (and video) on implementing search-based RAG question answering using Claude 3.5 Sonnet, https://val.town/ and Datasette
I extracted the notes and code from the livestream I recorded with Val.Town founder Steve Krouse yesterday morning, where we hacked everything together in about an hour https://simonwillison.net/2024/Jun/21/search-based-rag/
You don't need fancy vector search to build RAG! Good old-fashioned BM25 full-text search (as seen in SQLite) is more than capable on its own
Simon Willison /
npub13v…4w5eu
2024-06-21 23:21:56
Author Public Key
npub13v97j0kknscwnf5pt87nsn7cxzxwfwl3dsu7ss8qsq7ukmqgwg8q84w5euPublished at
2024-06-21 23:21:56Event JSON
{
"id": "7456d4da5b45ebb2644097eea93462ad2643c606ebb8ac5183c0594e07a745c6",
"pubkey": "8b0be93ed69c30e9a68159fd384fd8308ce4bbf16c39e840e0803dcb6c08720e",
"created_at": 1719004916,
"kind": 1,
"tags": [
[
"proxy",
"https://fedi.simonwillison.net/users/simon/statuses/112656706219799808",
"activitypub"
]
],
"content": "Here are my detailed notes (and video) on implementing search-based RAG question answering using Claude 3.5 Sonnet, https://val.town/ and Datasette\n\nI extracted the notes and code from the livestream I recorded with Val.Town founder Steve Krouse yesterday morning, where we hacked everything together in about an hour https://simonwillison.net/2024/Jun/21/search-based-rag/\n\nYou don't need fancy vector search to build RAG! Good old-fashioned BM25 full-text search (as seen in SQLite) is more than capable on its own",
"sig": "7b5dd704a27f1f522c305b7873fca4406066320cd58a561699d856d7a639d322cbb026be7bae2e4da01532b3c7f38abf13c93006e7f3ca3b2b2554f3c7c8e1ed"
}