The side street of the now former Windsor Castle is called Windsor Place. So, either the pub was named after the street, or the street was named after the pub, priior to it being renamed The Cardinal. I beieve that this is evidence to support its original name. Photo below.
DB.