I don't see the problem, I guess. I've always used this term when referencing visiting my folks... I don't consciously do it, and when I leave there to come back, I also say I'm going home. But the hubs... just doesn't get it - "home" should be reserved for this place alone! I have two comments...
- He still lives in his hometown, therefore he never really is going back. His folks also still live here, so of course this place being the one and only "home" is doubly reinforced for him.
- This dual use of the word is not unique to me. My sisters also do the same thing. Maybe it's a family thing, I don't know.
So... I'm curious to know, is this unique to my family or do you also refer to other places as "home" when you are headed back for a visit? I'd like to know!