#inference

1 result

Glossary

Beginner ai

Token (AI)

A token is the basic unit of text an LLM processes - roughly 3–4 characters or 0.75 words - used to measure input length, output length, and API cost.