[JeffF.]

Re-reading the appropriate parts of the Simarillion, it says the Peoples of the coasts were related or of Elendil's folk hinting that there were many colonies besides Pelargir and Lond Daer.

There may have been a significant population of the Faithful in Middle Earth around the coasts that later became Gondor and SW Arnor.