often seen in the street without a hat

There is a book, I think it is by Michael Frayn, where a bloke sleeps with a woman - I think she is a novelist whose books he teaches at a university - and is shocked! shocked I tell you! that her bra doesn't match her knickers. I can't remember whether this causes him to reassess the literary criticism of her work on which his entire career is based.