Blog, page 3

Breaking up is hard to do: Chunking in RAG applications

Some say that chunking strategies need to be custom for every document that you process. You can use multiple strategies at the same time. You can apply them recursively over a document. But ultimately, the goal is to store the semantic meaning of a document and its constituent parts in a way that an LLM can retrieve based on query strings.

Higher Order Company

No need to deal with the complexity of concurrent programming: locks, mutexes, atomics... any work that can be done in parallel will be done in parallel.

Brotzky on making AI reliable

Our prompts are moderately long, very specific, repeat key requests multiple times, and we provide examples of good answers in the prompt.

Canopi — The Home Screen for your Life

We store things in app silos without any association between things that belong together. And in turn, we lose out on all the value that comes from connecting related information.