As a non GoT watcher, that is awesome seeing that many references but they seem to not rely on the references alone to work, as I am loving this show as well without knowing any of all that lol.
I am only on episode 6, I have attempted to watch no more than one episode a day and re-watch episodes rather than just quickly try to move forward, it really is an awesome show and just trying to enjoy it now before I forget about it until the next season like every other show now in days.