Glossary · Phase 6 · Modern LLM engineering
constitutional AI
Training a model to critique and improve its own answers against a written set of principles.
Learn it properly
Constitutional AI · Training with AI feedback guided by written principles. About 35 minutes.
Other terms from the same lesson
- false refusal: A model refusing a request that was actually harmless, such as declining to explain how locks work.
- jailbreak: A prompt written to trick a model into ignoring its safety rules.
- RLAIF: Reinforcement learning from AI feedback: like RLHF, but an AI model applying written principles does the judging instead of people.