evaluation
4 notes tagged evaluation in the Applied LLMs topic. Putting language models to work: retrieval, prompting, evaluation and the behavior you only learn in production.
- LLM as a judge
With the robust growth of LLM models currently, there is a new method is used to evaluate the performance of large language models (LLMs): LLM-as-a-Judge, also known as…
- Evaluation guidelines for LLM applications, part 1: the evaluation checklist
A product evaluation checklist and the business and user expectations to settle before integrating a third-party LLM into an application.
- Evaluation guidelines for LLM applications, part 2: types of evaluation and considerations
The difference between model evaluations and product evaluations, plus coverage, monitoring, user feedback and when fine-tuning is needed.
- Evaluating search engine in RAG systems
Hybrid search comes to solving problems in vector search and full-text search. Let's see how it works. In this article, we will know how hybrid search approach and how…