Well, it sounds as if your unions are not necessarily pulling their weight at the moment. However, I think your view that they are no longer needed is immensely privileged, and I think if your desire came to pass you would probably find out in very short order that whoops, that wall was load-bearing after all.

I could be wrong, but I don't believe so.