+1 for this! Some considerations I thought of: 1. smaller keyboards don't easily have access to upper octaves. 2. User might frequently change the transpose on their keyboard.
Could there be a Create Bookmark Now button in the app as a fallback?
GPS location, depth, exposure settings, focus distance could be incorporated into the signed data. Also if the image is high enough resolution you could pick out individual pixels/subpixels in the screen.
I can imagine that this could be a way to adjust the effect as needed.
Windows has built-in color filters already but to my knowledge it does not allow to customize them, though. Open this in the run dialog (Win+R) to directly open to the appropriate settings page: ms-settings:easeofaccess-colorfilter
Encoders are great for this too. Music hardware often uses mappable encoders with LED rings to indicate the current value, and/or with the screen showing what the encoder is controlling.
Yep -- my favorite version of this is in the Ensoniq ESQ-1. 1980s box that helped pioneer the use of digital readouts in synths. Digital readouts eventually became terrible in synths because of "menu diving" (look into the Yamaha TG-33 for an awful example). But the ESQ-1 had a few cool features to keep editing simple:
1. The entire page hierarchy was only one level deep. You had 10 buttons that select a parameter, and a single data entry slider. So, with two hands, you could very rapidly manipulate parameters. I believe the Yamaha DX7 also had this, but what made the ESQ-1 cool was that the button usages were listed right on the digital readout next to the buttons themselves, rather than off to the side and hard-coded to the parameter. So it was like hitting a hardware button that could automatically remap.
2. Again unlike the DX7, there was no button-press needed to "edit" -- you just hit the button and moved the slider. It felt very natural to use even though it was technically a digital parameter being editing. If you needed additional editing power, you could still hunt for the other buttons outside of the 10 "screen" buttons.
I had one about 5 years ago, and swapped it for a JP-8000. I regret it. Very cool synth, very innovative UX.
Even for buttons I've seen small matrix displays beside the button (or even underneath its plastic shell) acting as the label and indicator. This prevents the need of having the programmable buttons next to the screen, but at increased cost.
I have a Roland FANTOM keyboard which has a touchscreen UI, however it also has a row of knobs and buttons that offer an alternate control surface without having to touch the screen. It's so much better.
Here’s another interesting one, storing energy in heated metal, and later converting the emitted light back to electricity using specialized PV cells: https://youtu.be/Gn7pfYKB7DA
Could there be a Create Bookmark Now button in the app as a fallback?