N0NAM3, overclocking requires stability and testing for stability is required before gaming.
To me it may be an unstable CPU overclock, a MEM instability (not necessarily because of an overclock) or both CPU and MEM are not working properly with each other. Look at the steps outlined below and see where you might have gone wrong. The outlined steps are to give you ideas and aid you along. Note that you can Google or search this forum for specificts on each step outlined in this post for clarity.
01. Upgraded your OS to lastest patches
02. Flash to latest Bios
03. Install latest Chipset Drivers
04. Install latest GPU Drivers
05. Install latest Sound Card Drivers (if you have one installed)
06. Download the latest overclocking software aids; Prime95, CPUZ, CPUID, GPUZ & RivaTuner
a) Prime95 has three main tests;
- Small FFTs; to test CPU stability
- In-Place Large FFTs; to test CPU and some MEM usage
- Blend; to test CPU and lots of MEM usage
b) CPUZ - Provides info on CPU overclock and CPU VCore voltage
c) CPUID - Provides voltage readings on many things including all
the Cores in your CPU at Idle and Load temps
d) GPUZ - Provides info on GPU(s) overclocking
e) RivaTuner - Overclocks GPUs and provided direct FAN Controls
07. Disable/Enable features in Bios (that will either help or hinder an overclock)
08. Leave your MEM at stock speeds and losen timings @ factory recommended volts (to take MEM stability out of equation when first overclocking the CPU)
09. Overclock your CPU while tweaking the voltages on CPU VCore, CPU FSB, South/North Bridges and HT (equivalents on your own MOBO) and testing for stability using Prime95, CPUZ and CPUID
10. Perform the VDroop MOBO chip 2HB pencil mod to cancel CPU VCore dips when CPU is Idle and the mod will increase volts by 0.02 on Load (if applicable)
11. Restore MEM to stock timings/overclock and run Prime 95 Blend test to test for stability
12. Overclock your GPU(s) using RivaTuner (can use software from NVIDIA, EVGA or ATI for GPU overclocking if you chose) and GPUZ
13. Set-up direct GPU FAN control in RivaTuner with three separate profiles (60% - 80% - 100% speeds when temperatures reach 45-55C - 56-65C - 66-200C respectively)
14. Tweak Win Vista to run better for a Gamer
15. Defrag Drive
16. Install games and play without fear of crashing!