Ragas and Elasticsearch #270
Description
I've built a Streamlit based RAG pipeline workbench that lets developers experiment using different prompt techniques, LLMs, model temperatures, and document chunking approaches. The results are objectively measured and compared using Ragas and exported to Elastic for visualisation using a dashboard that is part of the repo and can be imported by the user. I've also included LLM interaction logging as part of the app in order to help developers keep track of costs and compare the differences between the models they're using. Ultimately I would also like to write a blog around this and I have taken assignment of the search labs ticket of the same title.