Agree with area51 there shouldn't be a problem. However if you do want to delete it regardless you don't have to delete everything to get rid of outlook.
If you just want to delete outlook go to start, controle panel, unistall programs, right click office 2010 and select change. Add remove features, select outlook, feature not available (little x).