Your PSU wattage alone means nothing, which model and which brand? But the real problem
is your motherboard,which may not handle the excess of voltage properly, and as you are new to this,
it might be risky. (I am not trying to discourage you, just for you to know all the parameters)
And you must buy another cooler for your CPU if you want to overclock. With that out of the way,
Full of guides,ask anything and I and others will help you out.
And some quick answers
Max CPU Voltage (VCore) 1.5v
Max temps AMD says 62*C is the absolute maximum.
50-55*C is what almost everyone here will suggest,me as well.
RAM overclocking will not offer much, your NB Frequency is what you have to raise.
Programs you are going to need are
CPU-z (you have it), HWMonitor (to check the temps), Prime 95 for stability testing
On the AM3 section,press the Asus tab, your motherboard is before the last one at the bottom.