llm-api

Files

T

History

asepharyana e8f90fc9b1 feat(metrics): prometheus /metrics + generation timing in usage

- /metrics endpoint: request/token/latency counters, tok/s gauge, build info (std-only, no deps)
- usage.duration_ms + usage.tokens_per_second in non-streaming and streaming responses
- /health now reports uptime_s, n_ctx, version
- MAX_TOKENS env config (hard cap, default 2048; 0 = unlimited)
- metrics unit tests (counters, prometheus shape, uptime monotonic)

2026-08-03 11:44:21 +07:00

application

fix(stream): robust reasoning/content split + flush un-tagged output

2026-08-03 11:03:26 +07:00

bootstrap

refactor(chat): unify generation flow and fix tool/streaming bugs

2026-08-03 08:58:13 +07:00

config

feat(metrics): prometheus /metrics + generation timing in usage

2026-08-03 11:44:21 +07:00

domain

feat(metrics): prometheus /metrics + generation timing in usage