After some more research, I found the pdfcropmargins command line tool, which does the job pretty well. I made a macro to pass in the selected finder files as arguments.
This adds 2 inches of margin to the right side:
pdfcropmargins -o output.pdf -a4 0 0 -144 0 input.pdf