Whisper Farm - Parallel Transcription
https://mikecann.co.uk/posts/whisper-farm-parallel-transcription
This is my extension to @ian 's excellent work on Work Stealing and features topics such as AI, Convex and Fly.io š
Stack
Work Stealing: Load-balancing for compute-heavy tasks
Compare push-based load balancing with pull-based work stealing as scalable strategies for distributing resource-intensive workloads, such as running ...
2 Replies
Wow a full MB of transcription text! I wonder if each chunk having its own text would be too much fetching to get it all, but the benefit would be search results that tell you roughly when it was from, out of the box!
If you ever get around to tackling the re-stitching problems, Iād be interested in what works for you.
Nice work
Thanks Ian š ye well I actually didnt measure how big the transcription text could yet but I was predicting that it was potentially possible so would like to have handled that case.
Agreed about the stitching problem, I would have liked to have tackled that. Maybe if I pick this one up again in the future š