hunch: millisecond-level AI decisions on cheap CPUs
Open-source project hunch turns Google's EmbeddingGemma 2 into a local, reflex-speed decision engine running directly on commodity CPUs. It acts as a fast student that learns from frontier LLMs and takes over repetitive chores like tool trace verification in just 22ms. Basically, it lets you slash agent inference bills without needing a GPU.