For quite a while I have been using Keyboard Maestro to automatically click on the "Keep me logged in" checkbox on Fastmail's login page. Recently Fastmail renewed their UI and now my macro no longer works, even though I did create a new screenshot of the checkbox (to be recognised and clicked on). Somehow the "click left button" on the image does no longer work...
Here's one way to do it using JavaScript. This way you don't have to worry about found images nor key commands. Try it out and let me know if it does or does not work for you.
NOTE: You will need to have "Allow JavaScript from Apple Events" checked in the Develop menu of Safari for this to work. Let me know too if that doesn’t make sense (or if you use a different browser).
Hmmm.... interesting! Then it sounds like just a matter of trying to grab a new screenshot and/or adjusting the fuzziness. Found image actions can be rather tricky to get just right. You could check the Display box in the actions to determine if KM is finding the image or not and go from there too.
Never tried Display before... Learned something new!
Unfortunately the results are rather disappointing:
when using the leftmost setting (sharp e), Keyboard Maestro does not detect the screenshot at all
when using the rightmost setting (fuzzy e), Keyboard Maestro detects all other corners (?!) with a score of over 60%, but the checkbox itself with a mere 4%... Huh? (My screenshot contains the checkbox plus the text "Keep me logged in" on the right)
Oh that’s great, glad to help! For me, starting to use dark mode is one of the reasons I started looking for better ways to interact with apps and websites to avoid found image issues. Glad you got it going!
I can't really speak with any authority on this but I imagine that has to do with the website itself as I experience the same thing sometimes on other websites.