I have been using Deepset AI Platform for around six months. I use Deepset AI Platform mainly for Gen AI model evaluation for our RAG application. For example, we are using Deepset Haystack open-source platform with a Gen AI evaluation framework called Ragas. We use Haystack to quickly assemble our RAG application pipeline to take the prompts and then interact with our vector database, which is Pinecone, and then process the query, get the response, and then compare it with the reference results provided by humans. We then use the LLM as a judge to perform evaluation and output the score for developers to see in order to evaluate the chunking strategy of their vector database.
I have been using Deepset AI Platform for around six months. I use Deepset AI Platform mainly for Gen AI model evaluation for our RAG application. For example, we are using Deepset Haystack open-source platform with a Gen AI evaluation framework called Ragas. We use Haystack to quickly assemble our RAG application pipeline to take the prompts and then interact with our vector database, which is Pinecone, and then process the query, get the response, and then compare it with the reference results provided by humans. We then use the LLM as a judge to perform evaluation and output the score for developers to see in order to evaluate the chunking strategy of their vector database.