World without Patents

Will the world be a lot different if the patent protections/the entire patent system is removed.
I believe it will be rather a lot simpler and will favour the society a lot, which is also the ultimate reason for patents to exist today.