AI glossary · Ethics, safety and privacy
AI alignment
AI alignment is the challenge of making an AI system’s goals and behaviour match what people actually intend and value.
Also called alignment
In more detail
An AI can follow instructions literally and still miss the point, or pursue a goal in ways nobody wanted. Alignment research tries to make models helpful, honest and harmless, and to keep them that way as they become more capable.
Techniques like RLHF are a form of alignment. Behaviours like sycophancy show how hard it is to get right.
Related terms
AI safetyAI safety is the work of making sure AI systems behave reliably and don’t cause harm, from everyday mistakes to serious misuse and long-term risks.Reinforcement learning from human feedback (RLHF)Reinforcement learning from human feedback (RLHF) trains an AI model to give better answers by learning from people’s ratings of its responses.AI sycophancyAI sycophancy is when a chatbot tells you what you want to hear, agreeing with you or praising your ideas, even when that makes its answer less accurate.Artificial superintelligence (ASI)Artificial superintelligence (ASI) is a hypothetical future AI that would be far more capable than humans at almost everything.
Browse related tools
AI tools listed on BroUseAI in these categories.
