brendan @brendonovich.dev · Jan 14

cap.so performs all video rendering in Rust, but uses a web frontend via @tauri.app. how does the frontend receive frames from the backend? WebSockets! we've found local WebSockets can handle >500mb/s of throughput, allowing us to display 1080p@60fps video on a <canvas>!

10 likes 1 replies

?

Replies

Marc-André Moreau · Jan 14

"RGBA frames via WebSockets" I'm sorry, what?! That's an insane amount of pixel data, even if it's on localhost. Have you tried using very lightweight codecs on those raw, uncompressed pixels?