I wanted to hold off on posting this until I got some successful responses but it does look like DIY carpenter bee traps work. Google "No Sting Bee Trap" for a video but here are some examples sent to me by folks who've made one themselves.