Extract text from forum and save to file

Anyone have an easy way of extracting text (and saving to file) from a forum thread like this one: Caingorms Snowy Owl Visitor | BirdForum

One of challenges would appear to be extracting text across multiple different pages of threads.

Are you trying to scrape the entire contents of a forum thread? If so, then a web scraper app is probably a much better solution than trying to do something with Keyboard Maestro, as they're written for such tasks, and (I would assume) can handle things like multi-page topics in forums.

Just keep in mind that some sites may react poorly to scraping activity if it's spotted in their logs, and your IP may be banned by some bot watching for such things.

If that's not what you're trying to do, a more thorough description of exactly what you'd like to extract would be helpful.

-rob.

1 Like

Doing that depends on the forum itself. For example, the Obsidian web clipper works well on this KM forum, but not so well on the one you linked to.

You might be better off asking the company that makes the forum platform. In your case it's xenForo.

2 Likes

Thanks all I want to do is add forum posts to a text to speech app, so I can listen to posts later. I could just copy and paste each post, but they would take too much time.

I just noticed that the forum you linked to has an RSS feed that you might be able to use to get the text of new posts. You can find the feed at the bottom of the page: