Tagged: rate-limiting

Rate limiting yourself: token buckets, adaptive throttling, and 429 backoff

Traces client-side rate control for crawlers: token and leaky buckets applied to your own requests, per-host concurrency, adaptive throttling on 429 and Retry-After, and exponential backoff with jitter.

crawling rate-limiting infrastructure

Fri, March 20, 2026 · 23 min read

Rate-limiting algorithms for defense: token bucket, sliding window, and GCRA

Traces the algorithms behind server-side rate limiting as an abuse defense: fixed and sliding windows, the log-versus-counter tradeoff, token and leaky buckets, GCRA, and how Redis enforces them across a fleet.

ddos rate-limiting web-security

Sun, December 21, 2025 · 25 min read