Event-Driven Spokes vs. Polling: How I Cut Agent Latency 40×
HackerNews' Firebase SSE pushes new IDs in under a second. Our old cron polled every 5 min. Switching saved more than latency.
Tools
2posts
2posts
HackerNews' Firebase SSE pushes new IDs in under a second. Our old cron polled every 5 min. Switching saved more than latency.
Running llama.cpp with --parallel 1 means concurrent agents starve each other at the HTTP queue. A file lock solves it cleanly.