Skip to content

[Feat]: Auto-Evaluation Metrics Based for every LLM Request #470

@patcher9

Description

@patcher9

🚀 What's the Problem?

Right now OpenLIT can show the LLM events but their is no automated way to see if a event performed good or bad. This can be done using Eval metrics that generally run against a dataset

💡 Your Dream Solution

Auto Evalutaion scoring for all LLM requests traced and stored in OpenLIT

🤔 Seen anything similar?

NA

🖼️ Pictures or Drawings

NA

👐 Want to Help Make It Happen?

  • Yes, I'd like to volunteer and help out with this!

Metadata

Metadata

Labels

🚀 FeatureNew feature or requestclientIssue related to OpenLIT Client

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions