Short windows, by design
Longer windows increase buffering and computation; temporal attention maps grow quadratically. At 30 FPS, estimated buffering plus engine inference delays the first frame by about 0.6 s (AGX Orin, 720p, mixed precision), excluding video I/O.
Window size and attention-map entries at 1280 × 720
- 12 frames11.1 million pixels144 entries
- 24 frames22.1 million pixels576 entries
- 36 frames33.2 million pixels1296 entries
Pixels per windowAttention-map entries per position and head