fix(infra): remove buffer/compress from llm-api for real SSE streaming
- llm-api uses llm-chain instead of common-chain - llm-chain excludes buffer & compress middlewares - Prevents Traefik from buffering streaming SSE responses - Each token is now flushed immediately
This commit is contained in:
@@ -27,7 +27,7 @@ http:
|
||||
- websecure
|
||||
tls: {}
|
||||
middlewares:
|
||||
- common-chain@file
|
||||
- llm-chain@file
|
||||
service: llm-api-service
|
||||
|
||||
# ── Tools (Document Scanner & Media Processing) ──
|
||||
|
||||
Reference in New Issue
Block a user