Its really not that hard.
Have you ever screwed a screw with a screwdriver?
Great! You can build a computer.
If you are still skeptical, then you can watch this video:
http://www.youtube.com/watch?v=d_56kyib-Ls
Its a little long, but very thorough, and its a bit nicer than if you bought a pre-built one.