Together AIBlog22 JanOptimizing inference speed and costs: Lessons learned from large-scale deployments