Yes, that wee pub was called the White Swan, just opposite Browns Square Barrack.
Thank you for infomation on White Swan