Token Factory

Routing

Attach a routing policy to a provider, models, and an organization or key.

Routing studio is where you attach a routing policy to a provider, a set of models, and a scope.

  1. Open Routing studio.
  2. Create a routing rule.
  3. Select the provider.
  4. Select the models the rule applies to.
  5. Set the scope:
    • Organization — the policy applies to that organization.
    • User / key — the policy applies to a specific key.
  6. Save the rule conditions (next section).
Photo 13 — Routing studio

Rule categories

Rules are grouped by the condition that triggers them. Two examples:

Token usage percentage. If token usage goes above a threshold you set (for example more than 70% or more than 80%), the rule defines how traffic should be routed from that point.

Budget. If budget utilization goes above the threshold (for example greater than 80%), later token consumption is redirected to the target model. In the sample setup, usage past 80% of budget is sent to Gemma.

Photo 14 — Routing rule and target model
On this page

On this page