I don't understand what the question really is. There are two aspects:
Do you want to have a more effective way how to sort the documents? Then sort them in a hierarchy like this: 1. job (subfolders 1.1 job A, 1.2 job B). Every time a category gets big enough it gets split up. Keep a good track of the hierarchy structure. This of course means that you will end up with more than a single folder, and can't carry around all of them.
Or is it the huge weight/volume of all that stuff? Then I'm afraid, you can't really do a thing about that other than scan all documents and only carry an electronic copy with you. It helps to sort the files just like you would do with physical documents.
My personal approach is this: I sort physical documents in a hierarchy like I wrote. If they are important they are scanned and stored on my computer. A good backup strategy (Apple time machine and an off-site backup every two weeks) saves them from fire or theft of my computer. Really important documents are stored in a safe deposit box and I only have a physical copy/scan at home.
Whenever I need to bring a physical document with me I take it out of its folder and put it back ASAP (in reality it sits on my desk until I clean it up...)
