since you're asking about the first one, I assume you don't need the extra shebang. It's not like you NEED an i5 for web browsing only, but if your budget is $600, why not? Better get something a little more powerful that will last a little longer over a crappier CPU that gets outdated faster. You'd definitely be fine with an i3 or even just that Pentium G3258 for basic day to day office task (browsing, email, MS office, etc).
The PSU is a bit high for this kind of build, but with a PSU, you don't want to skimp on quality. That XFX is basically the cheapest quality PSU you will find. Dunno about anywhere else, but in the PSU world, what matters is not the brand, but the OEM (aka, the people who actually make the PSU). All XFX PSUs are actually made by Seasonic, which is a top class OEM in the PSU world (most here would say it's the number 1 OEM for PSU) so you can't go wrong with an XFX unit. Having the extra wattage on top of an i5 will allow you to stick a gaming graphics card down the line and bam, you have a decent gaming PC. Corsair and EVGA's budget (very low end) PSUs are actually third tier or lower, so not really recommended, although I guess it's fine if you are just web browsing. EVGA and Corsair makes real quality PSU at the higher end, but that doesn't belong in your budget PC.
As for the video card, no it does not need it. But, it's not a gaming graphics card or anything, it's a media card (something you would stick into an HTPC). Remove if you don't want of course, it's just something I added because it's within budget and would help free up the CPU to do other tasks in applications that may take advantage of a GPU, like Photoshop.
At the end of the day, I gave you a list that is "the best bang for your buck" that would most fit your needs within the budget. A $600 budget is a lot if all you're going to do is web browsing (you can get a prebuilt netbook for half that price that would browse the web just fine). If you don't actually want to spend your entire budget, I can put together another list for a lower budget of your choosing.