"Smart @Docs", meta-index docs, and automatically decide which ones are relevant based on query

[TiagoTiago]

Validations

• I believe this is a way to improve. I'll try to join the Continue Discord for questions
• I'm not able to find an open issue that requests the same enhancement

Problem

Sometimes having to think of/search the specific keyword for relevant @Docs wastes some (not always too much, but at least some) amount of time.

Solution

Since the whole purpose of the AI assist system is to spare a few brain-cycles, I figure it would make sense to have some sort of meta-index of all the indexed docs that basically provides the system the gist of what each of the docs is about and what kind of thing it might have inside, sorta similar to how right now within each specific doc it can figure which pages are relevant; and with that, the user would be able to do something like add the @SmartDocs "context" and the system would figure out which @Docs to actually include in the search for specific content based on what the user is talking about in the rest of the prompt.

I imagine this hierarchical indexing/search approach would likely be less compute intensive than actually performing the search on all indexed docs.

This wouldn't necessarily replace the current @Docs system, since there could be situations where either due to ambiguity, or imperfections in the AI or in the RAG algorithm, the wrong docs might be picked up, or some important ones might get left out; users should still be able to call for specific docs directly like how it's currently done, the SmartDocs context would just be an additional option.

ps: Obviously, the name "SmartDocs" is just a placeholder, I'm sure someone can think of something better; I forgot to go sleep many hours ago.

[tomasz-stefaniak]

Good idea, seems like the natural next step

[TiagoTiago]

Maybe it might not even need a new keyword, just have it so if the user doesn't move to pick an specific doc and just leave @Docs in the prompt, it will trigger the smart behavior. And besides mentioning in the Continue documentation, also let the user know in the hover-tip that shows up when the user writes @Docs that functionality exists and they may choose to not further specify the docs and let the system try to deduce which to include.

What do you think?

[tomasz-stefaniak]

We'd love a contribution here if you are (or someone else reading this!) interested in implementing that.