fix: request payload for o1 models (#921)

Co-authored-by: Salman Mohammed <smohammed@squareup.com>
This commit is contained in:
Wendy Tang
2025-01-30 07:24:32 -08:00
committed by GitHub
parent 6e9423b8c4
commit e8ced5a385
4 changed files with 31 additions and 11 deletions

View File

@@ -17,10 +17,10 @@ Goose is compatible with a wide range of LLM providers, allowing you to choose a
|-----------------------------------------------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|---------------------------------------|
| [Anthropic](https://www.anthropic.com/) | Offers Claude, an advanced AI model for natural language tasks. | `ANTHROPIC_API_KEY` |
| [Databricks](https://www.databricks.com/) | Unified data analytics and AI platform for building and deploying models. | `DATABRICKS_HOST`, `DATABRICKS_TOKEN` |
| [Gemini](https://ai.google.dev/gemini-api/docs) | Advanced LLMs by Google with multimodal capabilities (text, images). | `GOOGLE_API_KEY` |
| [Gemini](https://ai.google.dev/gemini-api/docs) | Advanced LLMs by Google with multimodal capabilities (text, images). | `GOOGLE_API_KEY` |
| [Groq](https://groq.com/) | High-performance inference hardware and tools for LLMs. | `GROQ_API_KEY` |
| [Ollama](https://ollama.com/) | Local model runner supporting Qwen, Llama, DeepSeek, and other open-source models. **Because this provider runs locally, you must first [download and run a model](/docs/getting-started/providers#local-llms-ollama).** | N/A |
| [OpenAI](https://platform.openai.com/api-keys) | Provides gpt-4o, o1, and other advanced language models. | `OPENAI_API_KEY` |
| [OpenAI](https://platform.openai.com/api-keys) | Provides gpt-4o, o1, and other advanced language models. **o1-mini and o1-preview are not supported because Goose uses tool calling.** | `OPENAI_API_KEY` |
| [OpenRouter](https://openrouter.ai/) | API gateway for unified access to various models with features like rate-limiting management. | `OPENROUTER_API_KEY` |
:::tip Model Recommendation

View File

@@ -64,7 +64,10 @@ To set up Google Gemini with Goose, follow these steps:
## DeepSeek-R1
:::warning
Depending on the model's size, you'll need a relatively powerful device to smoothly run local LLMs.
In our testing, we have found the Google Gemini performs better that DeepSeek models, likely
because Goose relies heavily on tool calling and DeepSeek does not support it natively yet.
When using DeepSeek, we currently recommend the 70B model size, which requires
a powerful device to run smoothly.
:::
Ollama provides open source LLMs, such as `DeepSeek-r1`, that you can install and run locally.