Many people work on their sport at University, where they can access good sports facilities. For example, I believe Steve Redgrave (the British Olympic rower) studied at Cambridge University (which is known for it's rowing teams). So, these athletes must be fairly educated
Indeed, the Olympics used to be a Gentlemen's event, because a working man would not have the energy, time or money to train for it.