If the HTPC is only playing videos off the web or the HDD, 2GB would be enough RAM and a bit of extra speed is always nice.
However, if you are going to do more than that I'd go with the 4GB. Plus if it is laying around the house, just try the 2GB and if it isn't enough RAM just put in the 4GB later.