Does this happen if you put either blinker on?
Does it also happen if the brights are on? This may be the issue. Fog lights turn off when the brights are on, so the wrong ground / wire / something may have been used by the previous owner.
Do your fog lights turn on by pulling out on the stalk? Basically asking if they are stock?