Skip to content

Commit

Permalink
Add docs for using google llms (#1321)
Browse files Browse the repository at this point in the history
  • Loading branch information
larkinwc committed Apr 23, 2024
1 parent f40e91b commit ba556ea
Showing 1 changed file with 26 additions and 0 deletions.
26 changes: 26 additions & 0 deletions docs/guides/GoogleLLMs.md
@@ -0,0 +1,26 @@
# Google Gemini/Vertex LLM Guide

# 1. Completion

OpenDevin uses LiteLLM for completion calls. The following resources are relevant for using OpenDevin with Google's LLMs

- [Gemini - Google AI Studio](https://docs.litellm.ai/docs/providers/gemini)
- [VertexAI - Google Cloud Platform](https://docs.litellm.ai/docs/providers/vertex)


## Gemini - Google AI Studio Configs

To use Gemini through Google AI Studio when running the OpenDevin Docker image, you'll need to set the following environment variables using `-e`:
```
GEMINI_API_KEY="<your-google-api-key>"
LLM_MODEL="gemini/gemini-1.5-pro"
```

## Vertex AI - Google Cloud Platform Configs
To use Vertex AI through Google Cloud Platform when running the OpenDevin Docker image, you'll need to set the following environment variables using `-e`:
```
GOOGLE_APPLICATION_CREDENTIALS="<json-dump-of-gcp-service-account-json>"
VERTEXAI_PROJECT="<your-gcp-project-id>"
VERTEXAI_LOCATION="<your-gcp-location>"
LLM_MODEL="vertex_ai/<desired-llm-model>"
```

0 comments on commit ba556ea

Please sign in to comment.