What is Logits?
AI EngineeringLast updated:
The raw, unnormalized prediction scores a model produces before converting them to probabilities.
Logits are the outputs of the final neural network layer before softmax normalization. Temperature and top-p sampling operate on logits to control output randomness. Some APIs expose logits for custom post-processing and evaluation.