Tool Tuesday - Post Hole Digger **** Always check with your city before digging! ***** If you're planning to build a fence, you start with the posts. To set the posts, you will first need to dig the holes with a post hole digger. A pry bar of some sort is also helpful for breaking up the soil, and getting through rocks.