It does say in Appendix B, toward the end of the Third Age timeline, that Lorien and Mirkwood were both assaulted, so it is possible that Imladris also was. Elrond was no greater or more powerful than Galadriel and Celeborn (who, although he is mentioned but rarely was a very great Elf and was accounted the wisest of the Elves), and both had rings of power, and it was said of Lorien
Quote:
Three times Lorien had been assailed from Dol Guldur, but besides the valour of the elven people of that land, the power that dwelt there was too great for any to overcome, unless Sauron had come there himself. Though grievous harm was done to the fair woods on the borders, the assaults were driven back
|
I don't know whether Imladris was assaulted or not, but it would make sense.