multi doc

[icemoon-creative]

小白求问，这个支持add多个document，然后进行rag吗？非常感谢非常感谢

[icemoon-creative]

Hello, I'm new to this and would like to ask if it supports adding multiple documents and then performing RAG (Retrieval-Augmented Generation)? Thank you so much!

[medxiaorudan]

@icemoon-creative Currently, you may need to combine all the documentation together first and then build the tree, if you want to continue building on the existing tree, the project is still being worked on and you can find details in issue #17, issue #20 and issue #27.

[isConic]

@icemoon-creative multidoc does not work, like @medxiaorudan mentioned , you can hack it to build a giant document. But this approach is not very scalable. I've also seen document chunks that include details from multiple documents.

For multidoc, I would recommend checking out alternative implementations.

There are others that have replicated RAPTOR.
For example:

• Llamma index has a RAPTOR module/pack. https://github.com/run-llama/llama_index/tree/2f80ca3834906e82c69484f4193530f279058033/llama-index-packs/llama-index-packs-raptor/llama_index/packs/raptor

• Langchain has a RAPTOR notebook. This notebooks uses a clustering technique that even be more performant/reliable than the one in this github project. https://github.com/langchain-ai/langchain/blob/master/cookbook/RAPTOR.ipynb