Skip to main content
Arize AX computes the cost of every LLM call and trace from the price per token of the model that served it, so you can see where spend goes and compare models. Common models come with default prices. A custom cost config sets the price for a model that has no default, or replaces the default when your rate differs from it.

Create or clone a cost config

  1. Go to Settings → Cost Configs.
  2. Click Clone on an existing config, or create a new model.
  3. Enter the Model Name and the Price per 1M tokens for each token type. Optionally set Tiered Pricing Starts At and the LLM Provider.
  4. Click Create.
New Model form in Cost Configs with price per 1M tokens and tiers

View cost

The trace header shows the total cost of the trace.
Trace header showing total cost