aljaz/goose
1
0
Fork 0
mirror of https://github.com/aljazceru/goose.git synced 2025-12-18 22:54:24 +01:00
Code Issues Packages Projects Releases Wiki Activity

chore: update docs for ollama endpoint (#992)

Browse Source
This commit is contained in:
Salman Mohammed
2025-01-31 13:47:41 -05:00
committed by GitHub
parent 7a427c6d46
commit 16df22f817
2 changed files with 7 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
crates/goose/src/providers/ollama.rs
View File

@@ -53,6 +53,7 @@ impl OllamaProvider {
} }
async fn post(&self, payload: Value) -> Result<Value, ProviderError> { async fn post(&self, payload: Value) -> Result<Value, ProviderError> {
// TODO: remove this later when the UI handles provider config refresh
// OLLAMA_HOST is sometimes just the 'host' or 'host:port' without a scheme // OLLAMA_HOST is sometimes just the 'host' or 'host:port' without a scheme
let base = if self.host.starts_with("http://") || self.host.starts_with("https://") { let base = if self.host.starts_with("http://") || self.host.starts_with("https://") {
self.host.clone() self.host.clone()

6
documentation/docs/getting-started/providers.md
View File

@@ -164,6 +164,12 @@ Ollama provides local LLMs, which requires a bit more set up before you can use
1. [Download Ollama](https://ollama.com/download). 1. [Download Ollama](https://ollama.com/download).
2. Run any [model supporting tool-calling](https://ollama.com/search?c=tools): 2. Run any [model supporting tool-calling](https://ollama.com/search?c=tools):
:::info Ollama Endpoint Construction
For Ollama, we set default host to `localhost` and port to `11434` if you don't provide it. When constructing the URL, we preprend `"http://"` if the scheme is not http or https.
If you're running Ollama on port 80 or 443, you have to set `OLLMA_HOST=http://host:port`
:::
:::warning Limited Support for models without tool calling :::warning Limited Support for models without tool calling
Goose extensively uses tool calling, so models without it (e.g. `DeepSeek-r1`) can only do chat completion. If using models without tool calling, all Goose [extensions must be disabled](/docs/getting-started/using-extensions#enablingdisabling-extensions). As an alternative, you can use a [custom DeepSeek-r1 model](/docs/getting-started/providers#deepseek-r1) we've made specifically for Goose. Goose extensively uses tool calling, so models without it (e.g. `DeepSeek-r1`) can only do chat completion. If using models without tool calling, all Goose [extensions must be disabled](/docs/getting-started/using-extensions#enablingdisabling-extensions). As an alternative, you can use a [custom DeepSeek-r1 model](/docs/getting-started/providers#deepseek-r1) we've made specifically for Goose.
::: :::