Yeah, you could do it that way. Personally though I'm going to build a voltage regulator based on the information on this link. I'd like to control more that one fan with this circuit. I've also seen a kit that has everything you'd need including a circuit board. Where you'd get that just now I don't know, that link must be on my other computer, I'm "on the road again" and on the laptop.
In order to help you any further on just using a potentiometer I'd need to know how many amps that fan draws. That information should be on the fan's label.
In order to help you any further on just using a potentiometer I'd need to know how many amps that fan draws. That information should be on the fan's label.