At Weathertop, did the Nazgul fear Frodo?

I dont understand where the idea that the Nazgul were scared of Frodo comes from, yes they did attack the camp cautiously, but they were afraid of Aragorn and the fire he wielded rather than a terrified 4 foot tall Hobbit.