Can you miss something you never had?

I only read the first sentence, but I really think you should go for it. He obviously still loves you and wants to be with you. Patience is bliss and ignorance is a virtue.