I choose to overclock because I can.
I CHOSE to look into overclocking because it is there, achieveable and its another side to computing that I wanted to explore. Its not about the epeen for me.
I enjoy the self education, the trial and error. The success along with the failure.
Unless you do something silly, a majority of components on the market, are basically designed to handle overclocking, over volting and whatnot.
The way I look at it is if you want to explore OC'ing....read, read, read, read, then read some more. Then, if you are comfortable with your whole rig going up in a puff of smoke, go for it.

Educate yourself first and know what to expect. Start slow until you get a feel for your equipment and what it can handle.
I do some interesting things with my PC's....Overclocking is part of it.