MACRO: Palette Organizer v1.3

They stay where you put them, so just do it manually. The next time they open, they'll be in the same place.

Or if you want to keep them with an application's window, even when you move the window, you could try something like this, which I also wrote: Sticky Palettes! They move when you do!.