Maybe he is scared. I would introduce him accidentally in a restaurant to the family. that way he can't really avoid it if they want to join you. Plus meeting a girls family shows how serious they are.