Have you explored the use of:
- Conflict Palettes
- Palette of Palettes
- Using Groups to restrict activation of macros and palette to app(s) or other conditions
- Use of a Global Macro that shows a palette for a group based on the frontmost app
If I understand your use case (and I'm not sure I do), perhaps one or more of these could meet your needs.