Temperature

A parameter in language models that controls the randomness of the output.

Description

Temperature is a hyperparameter used in language models to control the randomness of the output. It affects the probability distribution over the next token during text generation. A higher temperature (e.g., 0.8) makes the output more diverse and creative but potentially less coherent, while a lower temperature (e.g., 0.2) makes the output more focused and deterministic. The temperature is typically set between 0 and 1, with 1 being the default.

Examples

  • 🎨 Creative writing assistance
  • 📝 Code generation
  • 🤖 Chatbot responses

Applications

📚 Story generation
🎭 Dialogue system for games
🧠 Brainstorming tools

Related Terms