Glossary · Phase 1 · Building with LLMs
Rate limit
A cap on how many requests you may send in a set time. Go over it and the service replies with error 429.
Learn it properly
LLMs in automations · Put models inside scripts and workflow tools that run on their own. About 30 minutes.
Other terms from the same lesson
- cron: A standard way to run a program on a schedule, such as every weekday at 9 a.m.
- exponential backoff: Waiting longer after each failed try before trying again: 1 second, then 2, then 4.
- idempotent: Safe to run twice: doing it again has no extra effect, like pressing an elevator button that's already lit.
- jitter: A small random extra wait added before a retry, so many programs don't all retry at the same moment.
- webhook: A web address you give another service, which it calls when something happens, such as a new order.