Go outside at night to see what's munching on your tree. You can try a insecticidal soap spray to see if that helps or even make up a little hot pepper spray (google, if you're curious). Sometimes, you can just pick the bugs off.

Yay for gardens! I need to get this year's annuals and plant them so I can admire the flowers from my office window.