How to get rid of carpenter bees

A couple of months ago, when the weather began to warm up and the temperature was warm enough to sit outside in the afternoon, a large bee would hover menacingly outside the door. 

It seemed like a dare: see if you can get by me to enjoy your yard! It wasn't long before I noticed that above the door was a piece of wood holding our awning up, with about thirteen 1/2 in holes in it, the work of carpenter bees.