Media processing Workflow solution

This post introduces a media processing workflow solution built with Temporal. It details the problem of orchestrating complex, stateful, and fault-tolerant workflows, specifically for media processing involving IoT sensor data. The solution outlines the business requirements and maps them to Temporal Workflows and Activities. Key technical aspects covered include: defining Activity Options with `StartToCloseTimeout` and `RetryPolicy` for managing activity execution and failures; using `workflow.CreateSession` to schedule related activities on the same worker instance; and demonstrating how to handle conditional logic (e.g., terminating a workflow early if media is not obtainable) and iterative processing with retries. The post provides code examples in Go for the workflow, activities, and a simulated vendor API, illustrating the practical application of Temporal's durable execution for robust media processing pipelines.
More from the Durable Execution trail
- A conversation with StackAI's CTO: how Temporal cut indexing failures from 20% to below 0.1%
- Authentication is a long-running Workflow
- The thread is the Workflow: Durable AI agents without changing Agent code
- Stop restarting your tests
- How LlamaIndex uses Temporal to scale reliable document orchestration