for noob overclocking, just up the multiplier by .5 increments until you have stability issues, then back it back down a notch.
use Intel Burn Test for quick stability tests between bios adjustments.
download IBT here http://majorgeeks.com/IntelBurnTest_d5987.html
click on one of the download locations.
on boot/post press delete to go into the bios.
you'll want the advanced (or similar) page. use arrow keys no navigate and enter to change values.
Bio's vary a bit but you may have to change some setting to manual before you can change the multiplier.
When you raise the multiplier, your core speed will increase. press f10 to save your settings and load into windows.
use a temp monitoring program like core temp, or speedfan, or hwmonitor, to keep an eye on your load temps while running IBT (intel burn test)
You dont really want to get load temps higher than 55c.
Run 5 passes of IBT on standard and keep eye on temps. if all is good, restart into bios and up the multiplier another notch, then save and boot to windows and re-test.
once instability is reached (failed IBT or blue screen) back multiplier down a notch. Higher overclocks past this point will require voltage adjustments and other tweaks.