Correct.
My name, address and other information can be found readily enough in a phone book or in wonderful sites like the Property Appraiser's website. Public records make available a whole lot more information about me than I am pleased with, but at least several changes in the past decade or so have removed access to my SSN from easy viewing on public records.
The major reason for concern, of course, is the potential for identity theft, and you need to have the SSN to start that process.