I've been working on this project for the last 5 months, inspired by Screen Studio but runs 100% in the browser.
Here is a demo of the editor: https://www.youtube.com/watch?v=k7-etsFZgPI
One of the big challenges of using the browser is getDisplayMedia, the API for recording screens, doesn't provide mouse coordinates for security reasons. Mouse coordinates are important for auto-focus animations. So I trained a YOLOv11 model to detect mouse cursors and I run inference in real time while you record.
Also, I created my own Remotion-style renderer because I started with remotion and had a hard time adapting my particular codebase with to work with it as well as other challenges. It's great but I just had more success doing it myself for my use case, and it was an amazing learning experience.
I have a youtube https://www.youtube.com/@codingbutclueless
and a Discord: https://discord.com/invite/QpzFWgnsQH
Thanks for checking it out. Let me know what you think.