Should we have all our binaries in one folder?

Can we estimate what needs to be done to achieve this? I like the idea of having all binaries in one folder hierarchy, but just depends on how it finally looks.