I receive the following error when adding my custom data which is a .txt file (it doesn’t matter whether I add it via Azure Cognitive Search, Azure Blob Storage, or File Upload or whether the respective Congnitive Search index contains any data):
The error as text:
Error
Server disconnected
LLM call failed for chat completion endpoint. Please set OAIGenerationConfig(is_chat=True)
After removing the Data Source, everything works fine again and the bot responds to my queries.
I am using an Azure OpenAI Service with a gpt-35-turbo deployment, which has the following details:
Version: 0301, Deployment Type: Standard, Capacity: 120K TPM
I have no idea at the moment how I should further approach this problem.
Any advice is much appreciated!
2
Answers
The solution to this problem for me was to redeploy the OpenAI resource to a different region. I had the problems on West Europe, it seems to work fine on the East US region.
can you test the same in another region? It may hint on a possible issue in the original geography.