Glossary · Phase 6 · Modern LLM engineering
Jailbreak
A prompt written to trick a model into ignoring its safety rules.
Learn it properly
Constitutional AI · Training with AI feedback guided by written principles. About 35 minutes.
Other terms from the same lesson
- constitutional AI: Training a model to critique and improve its own answers against a written set of principles.
- false refusal: A model refusing a request that was actually harmless, such as declining to explain how locks work.
- RLAIF: Reinforcement learning from AI feedback: like RLHF, but an AI model applying written principles does the judging instead of people.