
Language Model Basics
Top-p sampling changes which tokens an AI model may choose next
Top-p sampling selects a changing set of likely next tokens. A small numerical example explains how it differs from choosing a fixed number of candidates.

Top-p sampling selects a changing set of likely next tokens. A small numerical example explains how it differs from choosing a fixed number of candidates.