Hi. I have a Sequoia, but my moms Avalon needs this done as well. While a quick look around seems to yield fewer 'do-it-yourself' types here then on the Sequoia forum (ie fewer postings on how to . . . - however, I did a search and came with this thread. The links may be helpful to you. Good Luck!
Replacement of rearview mirror housing