fix(auxiliary): honor main fallback chain for auto tasks (#47235)

This commit is contained in:
Teknium
2026-06-16 06:23:24 -07:00
committed by GitHub
parent 4d470b3dbb
commit 4858942c55
7 changed files with 290 additions and 38 deletions
@@ -687,7 +687,7 @@ For task-specific direct endpoints, Hermes uses the task's configured API key or
## Fallback Providers (config.yaml only)
The primary model fallback chain is configured exclusively through `config.yaml` — there are no environment variables for it. Add a top-level `fallback_providers` list with `provider` and `model` keys to enable automatic failover when your main model encounters errors.
The primary model fallback chain is configured exclusively through `config.yaml` — there are no environment variables for it. Add a top-level `fallback_providers` list with `provider` and `model` keys to enable automatic failover when your main model encounters errors. Auxiliary tasks whose provider is `auto` also consult this chain before Hermes' built-in auxiliary discovery chain.
```yaml
fallback_providers:
@@ -695,7 +695,7 @@ fallback_providers:
model: anthropic/claude-sonnet-4
```
The older top-level `fallback_model` single-provider shape is still read for backward compatibility, but new configuration should use `fallback_providers`.
The older top-level `fallback_model` single-provider shape is still read for backward compatibility, but new configuration should use `fallback_providers`. For task-specific auxiliary policy, use `auxiliary.<task>.fallback_chain` in `config.yaml`; there is no environment variable equivalent.
See [Fallback Providers](/user-guide/features/fallback-providers) for full details.