With Large Language Model innovation happening at a rapid pace, LLMs are presenting both opportunities and challenges for practitioners. One of the most prominent problems they face is how to strategically select the most suitable model for a specific enterprise application – a decision that holds far-reaching consequences for aspects like user experience, maintenance and profitability. Model selection requires a …

The rise of Large Language Models has paved the way for advanced conversational agents, powering various applications such as chatbots and virtual assistants. Often, the need for multi-turn evaluation is overlooked however, it is important to test a LLMs contextual understanding and coherence in complex conversations that extend over multiple turns or dialogues, mirroring real-world applications. This will help identify …