You've got a lot of "stuff" going on, at ALL LEVELS--subconsciously, spiritually, physically, neurologically, intellectually and YOU'RE NOT AS STRONG AS YOU WILL BE...Meds. take time, i.e. give it a good six weeks. You also have anxiety/self-esteem issues that need to be addressed and tackled/managed.
Hugs.
It sounds like a trillion crossed communication wires. Honestly, I don't know how to interpret this. You don't have to answer the door. You don't have to participate in anything or do anything that causes you moral/spiritual discomfort. And you don't need to appologize to anyone for living in accord with your truth. So, if you're uncomfortable in anyway--don't answer the door. Stand up for you.
Protect yourself with words, with expressing/behaving in accordance to your feelings. You don't need to tell this guy a story or give him any reasons or excuses. Just artfully ignore him. You're a busy lady. Tell him you must consult with your husband or something like that.