SDK for Anyscale Endpoint that makes it easy and cheap to use LLama 2
using Anyscale;
using var httpClient = new HttpClient();
var api = new AnyscaleApi(apiKey, httpClient);
var response = await api.CreateChatCompletionAsync(new CreateChatCompletionRequest
{
Messages = new List<ChatCompletionRequestMessage>
{
"You are a helpful weather assistant.".AsSystemMessage(),
"What's the weather like today?".AsUserMessage(),
},
Model = ModelIds.Llama2_70B,
});
var message = result.GetFirstChoiceMessage().Content;Priority place for bugs: https://github.com/tryAGI/Anyscale/issues
Priority place for ideas and general questions: https://github.com/tryAGI/Anyscale/discussions
Discord: https://discord.gg/Ca2xhfBf3v
