michal/mcpctl
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat: tiered LLM providers (fast/heavy) #43

Merged
michal merged 1 commits from feat/tiered-llm-providers into main 2026-02-25 02:16:30 +00:00
Conversation 0 Commits 1 Files Changed 17 +834 -285
michal commented 2026-02-25 02:16:23 +00:00
Owner
Copy Link

Summary

  • Adds tier-based LLM routing: fast tier (vLLM, Ollama) for structured tasks, heavy tier (Gemini, Anthropic) for complex reasoning
  • Multi-provider config format with full backward compatibility
  • Setup wizard with Simple/Advanced modes
  • Status display shows tiered providers via new /llm/providers endpoint
  • NamedProvider wrapper enables multiple instances of same provider type
  • All 599 tests passing (269 mcplocal + 330 CLI)
## Summary - Adds tier-based LLM routing: fast tier (vLLM, Ollama) for structured tasks, heavy tier (Gemini, Anthropic) for complex reasoning - Multi-provider config format with full backward compatibility - Setup wizard with Simple/Advanced modes - Status display shows tiered providers via new /llm/providers endpoint - NamedProvider wrapper enables multiple instances of same provider type - All 599 tests passing (269 mcplocal + 330 CLI)
michal added 1 commit 2026-02-25 02:16:23 +00:00
feat: tiered LLM providers (fast/heavy) with multi-provider config
Some checks failed
CI / lint (pull_request) Has been cancelled
Details
CI / typecheck (pull_request) Has been cancelled
Details
CI / test (pull_request) Has been cancelled
Details
CI / build (pull_request) Has been cancelled
Details
CI / package (pull_request) Has been cancelled
Details
9ce705608b 
Adds tier-based LLM routing so fast local models (vLLM, Ollama) handle
structured tasks while cloud models (Gemini, Anthropic) are reserved for
heavy reasoning. Single-provider configs continue to work via fallback.

- Tier type + ProviderRegistry with assignTier/getProvider/fallback chain
- Multi-provider config format: { providers: [{ name, type, tier, ... }] }
- NamedProvider wrapper for multiple instances of same provider type
- Setup wizard: Simple (legacy) / Advanced (fast+heavy tiers) modes
- Status display: tiered view with /llm/providers endpoint
- Call sites use getProvider('fast') instead of getActive()
- Full backward compatibility with existing single-provider configs

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
michal merged commit 78a1dc9c8a into main 2026-02-25 02:16:30 +00:00
Sign in to join this conversation.
Reviewers
No Reviewers
Labels
No items
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
michal
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: michal/mcpctl#43
Delete Branch "feat/tiered-llm-providers"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?