This is very cool. I was actually trying to do something like this with a side project over the last few years that lets you sketch out wireframes and add in logic and various custom components.

For me there is something really powerful in drawing freely with a pencil and not being constrained by the way tools (Figma, etc) make you think.

Anyhow side project is here if anyone wants a quick way to do wireframes and add in logic, components, etc - https://roughups.com

Specific lesson on using data here https://roughups.com/learn/boxes

This is really impressive. There's no video on how the "Logic" editor works. Have you thought about linking something like QuickJS and allowing actual code?

If one could write generic code, and if the properties of the inked objects were exposed to the runtime (i.e. corner points, stroke/fill colors, rotation, etc.) your app would be really close in functionality to the linked project.

Ah yeah I seem to have not uploaded the logic video there will track it down. It’s very much a first iteration at the moment but that is a great shout on using existing libraries. I also had ambitions to connect to data sources/apis etc so hopefully coming soon with that.

My ultimate aim is to get it so that you can actually publish a sketched app to the App Store… whether apple would accept a scribbled app or not I don’t know!

Oh, I love this.

Since you have a whole section on learning:

One thing I've noticed is that, at least on physical whiteboards, most people I've worked with weren't comfortable with their handwriting and drawing skills. Even when everyone agrees that "rougher is better."

For them I used to do a quick hands-on workshop back at Pivotal Labs. It was called "Whiteboard Hacking" (please don't judge ;) for which I also published a free small manual.

The manual with a bunch of exercises is still here for anyone who feels overly critical of their handwriting and drawing skills: https://publish.obsidian.md/alexisrondeau/Attachments/Whiteb... .

I’ve started making a more modern twist on this where you draw the prototype directly on your iPad rather than needing to take photos. Also let’s you make the prototype interactive with text fields, camera components and logic. Might be of interest - https://roughups.com

This is great - UI focussed more than UX, but very useful tips for developers - https://refactoringui.com

We wrote a similar article to this about a year ago, using CoreML & TuriCreate to train the data...

https://medium.com/jigsaw-xyz/realtime-image-recognition-in-...

TuriCreate also provides good tutorials on doing this: https://apple.github.io/turicreate/docs/userguide/object_det...