While it is good, we sometimes encounter hallucination issues, which is a significant concern. We are changing the prompt and fine-tuning it, but we still face some inconsistent behavior. We have specific instructions and keep the temperature very low to avoid overly generative responses, ensuring we receive specific answers from the particular source document without deviation; however, the results can sometimes vary. The main issue with Azure OpenAI is the inconsistency in output. We have a set template instruction, and it should generate within those parameters without any creativity because it's meant for regulatory authoring documents. The business provides the template instructions, and it should generate accordingly. While we have different prompts for various needs, sometimes it generates the correct results, and sometimes it does not, leading to inconsistency. For stability, based on the current model I am using, I would rate Azure OpenAI a 7 due to the ongoing hallucination issues.
