Will carpenter bees drill into dirt banks?

  We recently bought an acreage where we are going to build and was told about the carpenter bees. On the property there is a large revine and it appears that dozens of holes have been drilled into the surface. We're sure it is an insect but not sure what and being winter nothing is there yet.