Join us for an enlightening exploration into the world of Retrieval Augmented Generation (RAG) systems, where we uncover the intricacies of evaluation criteria and demystify the role of existing tools and frameworks. In this presentation, we'll dissect the essential components necessary for robust RAG evaluation, contrasting them with the offerings of current frameworks. From semantic understanding to content coherence, we'll highlight what truly matters in the evaluation process, empowering you to make informed decisions in the ever-evolving landscape of RAG systems.