QT/sure
1
0
Fork 0
mirror of https://github.com/we-promise/sure.git synced 2026-04-19 03:54:08 +00:00
Code Issues Packages Projects Releases Wiki Activity

docs: add env variable for ai debug to docs (#494)

Browse Source
This commit is contained in:
Blaž Dular
2025-12-23 19:57:32 +01:00
committed by GitHub
parent 60809dbf61
commit 8972cb59f0
1 changed files with 6 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
docs/hosting/ai.md
View File

@@ -188,6 +188,9 @@ OPENAI_URI_BASE=http://localhost:11434/v1
# Model you pulled
OPENAI_MODEL=llama3.1:13b
# Optional: enable debug logging in the AI chat
AI_DEBUG_MODE=true
```
**Important:** When using Ollama or any custom provider:
@@ -204,6 +207,7 @@ services:
- OPENAI_ACCESS_TOKEN=ollama-local
- OPENAI_URI_BASE=http://ollama:11434/v1
- OPENAI_MODEL=llama3.1:13b
- AI_DEBUG_MODE=true # Optional: enable debug logging in the AI chat
depends_on:
- ollama
@@ -235,7 +239,7 @@ volumes:
### For Chat Assistant
The AI assistant needs to understand financial context and perform function calling:
The AI assistant needs to understand financial context and perform **function/tool** calling:
**Cloud:**
- **Best:** `gpt-4.1` or `gpt-5` - Most reliable, best function calling
@@ -245,7 +249,7 @@ The AI assistant needs to understand financial context and perform function call
**Local:**
- **Best:** `qwen3-30b` - Strong function calling and reasoning (24GB+ VRAM, 14GB at 3bit quantised )
- **Good:** `openai/gpt-oss-20b` - Solid performance (12GB VRAM)
- **Budget:** `qwen3-8b` - Minimal hardware (8GB VRAM), still supports tool calling
- **Budget:** `qwen3-8b`, `llama3.1-8b` - Minimal hardware (8GB VRAM), still supports tool calling
### For Auto-Categorization