There are different kinds of entropy. In Chemistry, Phisics, and different kind used in organisational sciences. It is used here as figure of speaking. If it is hard to understand it, then use natural degradation instead.
Entropy can be described as natural force of evil
People saw that every organized system is trying to go to the most probably state, and this is a state of total chaos. With information you can slow down, stop or even negate this process. When someone is doing some dusting at home, or repairing etc, he is giving informations to that system slowing down entropy that wants to tear down his home.
I just think that this force is present in our minds, it is active toward our abstractions and emotions.
You know what, I even have tesis that gathering data and informations is the purpose of man's existance.