Is calling someone a 'narnian' implying you are in the closet?

This guy is joking around that I'm from Narnia and a "Narnian"...Does this mean he thinks I'm a lesbian. I'm definitely not but it's annoying me and I'm curious if that term is equated with being in the closet?