Yes it should run continously although it could be a variable speed one but it would never be meant to stop intentionally.
Is it a new PSU, I had a low powered PSU doing that recently, it didnt have enough power to start the pc so it tripped out and just made the cpu fan do about a quarter turn each time I pressed the start button :?