Summaries when the context window runs out

[mgraichy]

Hi, I've added the ability to summarize documents if desired: mgraichy/neuron-ai/

If you feel this is a good addition to the code base, I could open a PR.

(And kudos on the code base! Very clearly written, a real pleasure to work with)

[ilvalerione]

Instead of changing the internal structure of Neuron it could be implemented as a standalone package. It could be an implementation of the chat history that requires an AI Provider. Once the chat history has an instance of an AIProviderItnerface it can be used to perform summarization when needed.

Take a look at the QueryTransformation implementation:

https://docs.neuron-ai.dev/components/pre-post-processor#querytransformation

https://github.com/inspector-apm/neuron-ai/blob/main/src/RAG/PreProcessor/QueryTransformationPreProcessor.php#L22

It's a good use of the components already included into Neuron. It could be eventually published on NeuronHub