I would have wiped the trim down with a good deglosser,primed with XIM plastic and vinyl primer, and the a top line latex enamel.
Another thing in your post caught my attention......
that is letting other people dictate how you do a job.
You said 'The service manager wanted it white and had me spray it with a water base semi gloss.' Hopefully the service manager will shoulder some of the blame for the paint failure.
I use products and methods that I know and can guarantee.
When I encounter a customer that dictates how I do a job and what *products I use I usually excuse myself and wish them the best of luck.
*I always suggest BM but will use name brand paint of customers choice if they insist, but not caulk, putty/glazing, varnish/sealer, primers, ect.