Chat completion with your own data

[eeadie]

Hi,

I have been following the example to use your own data within Azure OpenAI (https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/use-your-data?tabs=ai-search). Following this I uploaded a number of markdown files which creates an index for me.

Is it possible to configure the Kernel/chat completion (C#) to use the search index created from my data?

Thanks,

Euan

[dmytrostruk]

@eeadie Yes, here is an example of configuring Kernel and Chat Completion service to use with your data:
https://github.com/microsoft/semantic-kernel/blob/1e94588c06a3e39421f89547eeda5823c37ef9b5/dotnet/samples/Concepts/ChatCompletion/AzureOpenAIWithData_ChatCompletion.cs

[guru98]

Hi, you are right but that api have some limitation e.g. doesn't support plugin. Probably could be better create your own plugin and call search api from there

[eeadie]

@dmytrostruk thanks this looks useful. I have created an Azure AI search index, however I can't seem to find how to get the DataSourceEndpoint. Would you be able to point me towards any documentation that details how to get the endpont once setup?

[dmytrostruk]

@eeadie You can go to Overview page of your Azure AI Search service on Azure portal, there will be Url field, which contains a value that you need to use for DataSourceEndpoint property in code.

[guru98]

Is the endpoint of azure serach on azure. You can found it in azure portal

…

________________________________ Da: Euan Eadie ***@***.***> Inviato: lunedì 29 aprile 2024 11:14 A: microsoft/semantic-kernel ***@***.***> Cc: Ugo Castellani ***@***.***>; Comment ***@***.***> Oggetto: Re: [microsoft/semantic-kernel] Chat completion with your own data (Discussion #6016) @dmytrostruk<https://github.com/dmytrostruk> thanks this looks useful. I have created an Azure AI search index, however I can't seem to find how to get the DataSourceEndpoint. Would you be able to point me towards any documentation that details how to get the endpont once setup? — Reply to this email directly, view it on GitHub<#6016 (reply in thread)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AA77TTU7EFSWFQBS3AY5PFLY7YFPDAVCNFSM6AAAAABG22SS76VHI2DSMVQWIX3LMV43SRDJONRXK43TNFXW4Q3PNVWWK3TUHM4TENRQGQ2TM>. You are receiving this because you commented.Message ID: ***@***.***>

[eeadie]

@dmytrostruk thnaks I managed to find the endpoint details on the Azure portal. Unfortunatley when invoking using chat completion GetSteamingChatMessageContentsAsync I am recieveing "Response status code does not indicate success: 404 (Resource Not Found)".

I am able to successfully interact with the Azure AI Search Index I created using VS Code REST client as suggested in this article (https://learn.microsoft.com/en-us/azure/search/search-get-started-rest). Any ideas why the call is not completing successfully?

[dmytrostruk]

@eeadie If Azure AI Search index works correctly when you test directly, could you check if Azure OpenAI ModelId and Endpoint are correct? ModelId is actually used as deployment name, so in case if in your setup deployment name and model id are different, you have to specify deployment name.

[eeadie]

@dmytrostruk the deployment name and model id are the same in my setup. The following config works (without data config):

When I switch to use config AzureOpenAIChatCompletionWithDataConfig I got the error mentioned above even though I can call Azure AI Search index directly without issue.

[guru98]

try tu use .AddAzureOpenAIChatCompletion(config: completionWithDataConfig) where in completionWithDataConfig you can configure all the values you try to use before.

[eeadie]

@guru98 I have already tried this, see the comment above

[ErikSkaarup]

Just for the record i see the same problem getting 404 using completionWithDataConfig, the individual services does work with the same credentials.

[dmytrostruk]

@eeadie @ErikSkaarup I'm going to investigate this issue and will back to you soon.