Token Cost

The price charged per token (input and output) when using LLM APIs. Token costs directly determine an AI agent's operating expense. GPT-4o charges ~$2.50 per million input tokens; Claude 3.5 Sonnet charges ~$3 per million. Optimizing token cost involves choosing the right model size for each task, caching common queries, and minimizing unnecessary context in prompts.