The question is can it find text across a line break. So, using your example agin, if the search term is:
select multiple adjacent
...if the screen contains:
So it's not possible to select multiple
adjacent words by clicking?
...will you get 2, 1, or 0 possible rectangles to click on?
I can see it going either way, depending on how the OCR processes the image, the smarts in the "find", and so on. But I suspect that the answer is "no match found".
Thank you so much @ronald for your explantation and examples.
I just ran a quick test yesterday with a single word which worked great. For my approach this would be sufficient in most cases. I'd use this feature not to copy or process any text but in cases where "Found Images" are not working reliably and apps are not providing any buttons to press.
I only wonder if it would be possible to kind of remotely call such a predefined action from BTT triggered by a Script from KM. This would enable to integrate this feature into KM macros. But I'm not experienced with scripting and haven't found the time to read more in the BTT manual.
There are 2 ways of activating BTT trigger via a KM macro. Right click on BTT trigger and choose between a URL and an AppleScript to activate the BTT trigger
But there is a much more flexible way when using the JSON of a particular action in AppleScript, JXA or even JS … so you don’t need to build with Triggers of BTT.
The JS option could be used in HTML Windows within BTT or Macros with the Custom HTML Prompt action.
Speaking of the other two options - I am currently working on a side project that contains a lot of KM Plugins for those who use BTT in conjunction with KM and do not want to use scripts or aren’t able to use or write them properly.
Since I currently have only one hour left per week at the moment I don’t know when those PLugins are ready to post them here.
Until then you’ll have to bear with me on this project and use scripting.
That sounds interesting, but the BTT function seems sufficient to me. I'll mainly use it in situations like browsers where "Found Image" doesn't work and something isn't available as a button or link.
It looks interesting too. I wonder if it, like BTT, is using a binary search algorithm like my MoveMouseToWord macro, or if they managed to get the macOS OCR API to return the location of the found text. If the latter, I hope KM can add support for that feature.
I have asked Ryan if he can add a feature to only scan a defined rectangle on the screen. In it’s current incarnation the app is not usable for me (too many hits).