A Guide to RAG Evaluation and Monitoring (2024)

We share a brief introduction to the factors that affect the performance of a RAG stack and includes an emphasis on the importance of creating a benchmark dataset to ensure the proper functioning of the stack. Finally, we will tackle the monitoring best practices for continuous value delivery.

RAG Evaluation Series: Validating OpenAI Assistant's RAG Performance, Blog

Why you need LLMOps - Artefact

Gartner RAG Tips for Grounding LLMs with Relevant Internal Data

Retrieval Augmented Generation (RAG) for LLMs

LlamaIndex: How To Evaluate Your RAG (Retrieval Augmented Generation) Applications, by Ryan Nguyen

Edition 27 – RAG Evaluation

RAG Evaluation: Ultimate Starter Kit

FX (Francois-Xavier) L. on LinkedIn: 2 years ago, with Edouard D

Retrieval Augmented Generation (RAG) with MLFLow