Will I need a thermal paste

Solution
If you are just using the stock CPU cooler, you do not need it. It will come pre-applied. It goes between the CPU and CPU cooler to help the transfer of heat.

Neither of those motherboards is great, but the ASUS is better.