Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: add llm eval blog post #1331

Merged
merged 2 commits into from
Mar 4, 2025
Merged

docs: add llm eval blog post #1331

merged 2 commits into from
Mar 4, 2025

Conversation

jannikmaierhoefer
Copy link
Contributor

@jannikmaierhoefer jannikmaierhoefer commented Mar 4, 2025

Important

Adds a new blog post on LLM evaluation best practices and challenges, covering evaluation methods, techniques, and application-specific challenges.

  • New Blog Post:
    • Adds 2025-03-04-llm-evaluation-101-best-practices-and-challenges.mdx to pages/blog/.
    • Title: "LLM Evaluation 101: Best Practices and Challenges".
    • Author: Jannik.
  • Content Overview:
    • Discusses evaluation challenges, including defining goals and subjective interpretation.
    • Explains the use of traces for detailed logging and performance measurement.
    • Compares online vs. offline evaluation methods.
    • Describes common evaluation techniques: user feedback, implicit feedback, manual annotation, and automated evaluation.
    • Covers automated evaluation techniques and application-specific challenges.
    • Provides a guide for getting started with LLM evaluation, including data collection and method experimentation.

This description was created by Ellipsis for 603b492. It will automatically update as commits are pushed.

@dosubot dosubot bot added the size:L This PR changes 100-499 lines, ignoring generated files. label Mar 4, 2025
Copy link

vercel bot commented Mar 4, 2025

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Updated (UTC)
langfuse-docs ✅ Ready (Inspect) Visit Preview Mar 4, 2025 4:24pm

@dosubot dosubot bot added auto-merge This PR is set to be merged docs labels Mar 4, 2025
Copy link

github-actions bot commented Mar 4, 2025

📦 Next.js Bundle Analysis for langfuse-docs

This analysis was generated by the Next.js Bundle Analysis action. 🤖

New Page Added

The following page was added to the bundle from the code in this PR:

Page Size (compressed) First Load % of Budget (350 KB)
/blog/2025-03-04-llm-evaluation-101-best-practices-and-challenges 44.52 KB 378.4 KB 108.12%

…allenges.mdx

Co-authored-by: ellipsis-dev[bot] <65095814+ellipsis-dev[bot]@users.noreply.github.com>
@jannikmaierhoefer jannikmaierhoefer added this pull request to the merge queue Mar 4, 2025
Merged via the queue into main with commit 7488356 Mar 4, 2025
7 of 8 checks passed
@jannikmaierhoefer jannikmaierhoefer deleted the llm-eval-blog-post branch March 4, 2025 16:23
@dosubot dosubot bot removed the auto-merge This PR is set to be merged label Mar 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
docs size:L This PR changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant