Is overclocking too advanced? This will be my first time building and overclocking.
Not really - set your base clock (BCLK) to one level, set your system multiplier to another, and set your voltage to another and you're set. Where the hard part comes in is that every single system is different and will give you different results - no two overclocks are exactly the same, and forums are reluctant to give out system specific information because of that.
even then it is hard to tell how much voltage you need
Yeah that's why most of the hardcore overclockers won't really tell you how to exactly overclock your system. They don't want to be responsible in case you fry your build if you set the voltage too high.