RAG Retrieval Evaluation Lab

<aside> ๐Ÿ‘‰

์ด ํŽ˜์ด์ง€์—์„œ๋Š” ํ”„๋กœ์ ํŠธ์˜ ๋ชฉ์ , ํ•ต์‹ฌ ๊ตฌํ˜„ ๋‚ด์šฉ, ์ฃผ์š” ํ‰๊ฐ€ ๊ฒฐ๊ณผ๋ฅผ ์ค‘์‹ฌ์œผ๋กœ ์ •๋ฆฌํ–ˆ์Šต๋‹ˆ๋‹ค. ์†Œ์Šค ์ฝ”๋“œ, ์‹คํ–‰ ๊ณผ์ •, ์ƒ์„ธ ํ‰๊ฐ€ ๋ฆฌํฌํŠธ๋Š” GitHub ์— ๋ณ„๋„๋กœ ์ •๋ฆฌํ–ˆ์Šต๋‹ˆ๋‹ค.

</aside>

images.png


๋ชฉ์ฐจ

  1. ํ”„๋กœ์ ํŠธ ๊ฐœ์š”
  2. ๋ฌธ์ œ ์ •์˜
  3. ํ•ต์‹ฌ ๊ตฌํ˜„
  4. ์ฃผ์š” ์„ฑ๊ณผ
  5. ํ‰๊ฐ€ ๊ฒฐ๊ณผ
  6. ์ตœ์ข… ๋ชจ๋ธ
  7. ๋Œ€ํ‘œ ์‚ฌ๋ก€
  8. ์ฟผ๋ฆฌ๋ณ„ ๋ถ„์„
  9. ํ•œ๊ณ„ ๋ฐ ๊ฐœ์„  ๋ฐฉํ–ฅ
  10. ํ”„๋กœ์ ํŠธ ์ดํ‰

ํ”„๋กœ์ ํŠธ ๊ฐœ์š”

RAG Retrieval Evaluation Lab์€ ๋ฌธ์„œ์™€ Gold Label์„ ์ž…๋ ฅํ•˜๋ฉด BM25, Dense, Hybrid, Re-ranker๋ฅผ ๋™์ผํ•œ ์กฐ๊ฑด์—์„œ ์‹คํ–‰ํ•˜๊ณ  ๊ฒ€์ƒ‰ ์„ฑ๋Šฅ์„ ๋น„๊ตํ•˜๋Š” ํ‰๊ฐ€ ํ”Œ๋žซํผ์ž…๋‹ˆ๋‹ค.