Data Structures Behind AI

A thread you can test

Hashing & Caching: Space for Time

2 notes move from the word to a real choice at work — understand it first, then decide whether to use it.

READING THREADOPEN
2notes
HOW TO READStart where you are stuck, then follow the evidence and trade-offs

Each note stands alone, or becomes the next step in this thread.

Data Structures Behind AINo login

THE QUESTION THIS PAGE ANSWERS

ANSWER FIRST

What is Hashing & Caching: Space for Time, and which AI decisions does it change?

Drop keys into buckets yourself—watch the hash function turn “walk the list” into a “direct hit,” then see how two keys colliding in one bucket get handled This page keeps the related concepts, common mistakes, and practical notes in one reading thread.

DECISION RULE

First decide whether you are blocked by a definition, a choice, or verification; then choose the closest of the 2 notes below.

TRY NEXT

Start with “Hash Tables: Why Lookups Are Unreasonably Fast,” then restate the conclusion using your own task.

WATCH FOR

Do not treat every method in a topic as interchangeable. The answer changes with the input, risk, and acceptance bar.

THIS QUESTION THREAD

Put the word back inside the choice it changes.

2 notes
Interactive

Hash Tables: Why Lookups Are Unreasonably Fast

Drop keys into buckets yourself—watch the hash function turn “walk the list” into a “direct hit,” then see how two keys colliding in one bucket get handled

Data Structures Behind AI 6 min →
Interactive

Caches: The Invisible Discount on Your AI Bill

KV Cache and semantic cache are the same move: don't recompute. Drag the hit-rate slider and watch the bill change live—the underlying principle of cost optimization in the Harness core part

Data Structures Behind AI 6 min →