Add combo round-robin strategy to distribute load across providers (#390)

- Add comboRotationState Map to track rotation per combo
- Add getRotatedModels() to rotate model order based on strategy
- Pass comboName and comboStrategy to handleComboChat()
- Add comboStrategy setting (default: fallback)
- Add UI toggle for Combo Round Robin in profile settings

When enabled, each request to a combo starts with a different provider
instead of always starting with the first one, distributing load evenly.

Co-authored-by: Antigravity Agent <antigravity@example.com>
This commit is contained in:
bitgineer
2026-03-23 09:52:31 +07:00
committed by GitHub
co-authored by Antigravity Agent
parent 6b0cced884
commit 96f5e5c92a
4 changed files with 85 additions and 8 deletions
+1
View File
@@ -54,6 +54,7 @@ const defaultData = {
tunnelUrl: "",
stickyRoundRobinLimit: 3,
providerStrategies: {},
comboStrategy: "fallback",
requireLogin: true,
observabilityEnabled: true,
observabilityMaxRecords: 1000,