Is a WearComp just a geeky way for people to always be playing with computers?

Well, it could be if someone wanted it that way - and if they did, fine: it's their choice. Mainly, though, WearComps are meant to aid us in whatever else we may be doing: walking around looking for an address, meeting people at a party, etc. When we sit down at a desktop computer, our primary task is to use the computer, and it requires our complete attention. Since WearComps are aware of, and leave us aware of, the environment, they are less demanding than a desktop computer; computing is no longer the primary task. Thus, WearComp actually frees us from the geeky, "always in front of a CRT" paradigm of computing.
Adapted from James Fung's Some Thoughts and Observations on Humanistic Intelligence and Mediated Reality