It now looks like Outlook works again unter Monterey Beta 5, problem solved (at least for now)!
For more information, see the wiki Searching the Forum for Answers section.