Torch compile caching for inference speed

What this post added

Introduced caching for `torch.compile` artifacts to reduce inference boot times. This involves storing compiled code across model container lifecycles, keyed by model version and stored near GPU nodes. The system reuses cached artifacts instead of recompiling and updates the cache on graceful container shutdown. This resulted in significant cold boot time reductions for specific FLUX models.