AiProductsHunt
Evidently AI

Evidently AI

Open-source evaluations and observability for LLM apps

Evidently AI Evidently AI Evidently AI Evidently AI
Evidently AI
About Details
Name: Evidently AI
Submited By: Adam Zemlak
Release Date 10 months ago
Website Visit Website
Category Open Source Developer Tools GitHub

Evidently is an open-source framework to evaluate, test and monitor AI-powered apps. 📚 100+ built-in checks, from classification to RAG. 🚦 Both offline evals and live monitoring. 🛠 Easily add custom metrics and LLM judges.


Joaquin Wisozk

It’s exciting to see an open-source platform that offers so much for AI monitoring and testing. The detailed metrics and continuous evaluation features are particularly noteworthy.

10 months ago


Trenton Spencer

I’m impressed by how this tool integrates LLM observability into one platform. It’s a great way to ensure my AI models are performing as expected and quickly identify issues.

10 months ago


Dorcas Parker

Congrats on the launch! Have you found that Evidently's suggestions are pretty consistent across solutions, or does it really depend on the application at hand? For example, does it always recommend ChatGPT over Claude (or vice versa), or does it depend on the use case? (And if you can share two use cases where the answer is different, that'd be super cool!)

10 months ago


Joany Hansen

Amazing team with a fantastic product that's solving real-need. Congrats team Evidently.

10 months ago


Rupert Emmerich

How does Evidently AI handle complex datasets?

10 months ago


Orrin Batz

How does Evidently AI handle complex datasets, and what level of customization is available for the reports?

11 months ago


Scotty Feest

Love this are toolkits as part of Evidently AI to cover some of the most important AIOps use cases like monitoring model hallucinations, etc. I'm new to building products with AI, I'm curious if there are learning resources for someone like me to learn more about topics like how to test AI generated results. Or does the AI has some suggestions on what methods to use? Also, big props for making the Evidently platform open source - you have my support for making this available to the world! Congrats on the launch @elenasamuylova and team!

1 year ago


Dejon Bergstrom

Evidently AI seems like a powerful tool for simplifying data insights. Looking forward to exploring its features! What makes Evidently AI stand out from other analytics tools?

1 year ago


Quincy Medhurst

Hello guys, congrats! How does Evidently help streamline the evaluation process for LLM-powered applications compared to traditional ML models?🤔

1 year ago


Rahul Goyette

The ability to quickly identify issues in machine learning models is invaluable. This feels like a powerful way to keep everything running smoothly. Good luck with the continued development!

1 year ago


Rahul Goyette

Hi Elena and the Evidently AI team! 🚀 It’s fantastic to see Evidently AI expanding into the LLM space. The ability to evaluate and monitor LLM performance is crucial, especially as these models become more integral to various applications. Can you provide an example or case study demonstrating how Evidently AI has successfully helped a project manage LLM evaluation and quality assurance, particularly highlighting the impact on model performance or user experience? Looking forward to seeing how Evidently AI evolves in this new domain and thanks for making such valuable tools open-source! 🛠️📊

1 year ago


Enrico Wiza

It’s impressive how this simplifies monitoring machines learning models. the clarity it offers is really beneficial for data teams.

1 year ago


Adam Zemlak

Cracked team solving one of the hardest problems in LLMs today. If anyone is going to solve it, it's them.

1 year ago


Randi Prohaska

The ability to track data drift and monitor model performance seamlessly is impressive. I’m excited to see how this can streamline AI observability in real-world applications.

1 year ago


Adam West

Congrats Elena and team! Taking evaluation to the next level with LLMs! 🔥

1 year ago