Its easier to imagine a loose connection than it is to suspect your psu can drive a pc with power requirements varying by at *least* 50W, but not run a very low power fan . . . at any time . . . only while at your house.
Try giving the fan a kick-start with your finger . . . while the pc is running . . . at your house. It may not be able to start up from one specific stopped position.