Yes 'at least 5 ft 6' is a bit surprising, but Gandalf was referred to as a 'little old man' in
The hobbit too -- until a revision in 1966 anyway, when he became an old man, for whatever reason.
Gandalf doesn't appear to have embiggened much however, if at all, even noting the revision