What BSOD is coming up? I'm assuming you've turned off automatic restart after BSOD?
If you haven't that would be the first thing that I would do, it will give you a big clue on whats going on if you can get the exact BSOD(s) that are going on. - You can also check the Windows log to see which bsod you are having.
Here is a list of frequent BSOD which have to do with overclocking, so if you see them, you know something may be in fact wrong with your o/c
0x101 = increase vcore
0x124 = increase/decrease vcore or QPI/VTT...have to test to see which one it is
0x0A = unstable RAM/IMC, increase QPI first, if that doesn't work increase vcore
0x1E = increase vcore
0x3B = increase vcore
0xD1 = QPI/VTT, increase/decrease as necessary
0x9C = QPI/VTT most likely, but increasing vcore has helped in some instances
0x50 = RAM timings/Frequency or uncore multi unstable, increase RAM voltage or adjust QPI/VTT, or lower uncore if you're higher than 2x
0x116 = Low IOH (NB) voltage, GPU issue (most common when running multi-GPU/overclocking GPU)
0X109 = Not enough or too Much memory voltage
*I did not write these, they were posted here on OCN I just use them as a valuable resource*