My fiance is so mad at me..?

Sometimes when my fiance goes out with friends at night without me I give him a hard time. I maybe act jealous or interrogate him with questions. I refuse to be attach�d at the hip and feel it's important to have time with friends. But I have a hard time showing that I trust him when he is out...only some times. Recently, it happened again, and he asked why I get that way. I finally dug deep to see why and I told him that I think it goes back to when we were young and in college (8 years ago) and another girl kissed him. I said maybe subconsciously I am afraid it will happen again if he drinks too much. Well after I said that, he shut me out. He wouldn't talk to me. Wouldn't acknowledge me and got really angry. He didn't talk to me for a day and it killed me. When he finally decided to talk to me, he said it really hurt his feelings that I don't trust him, and that now it all makes sense why I "nag" him or bug him when he goes out, but he is still very hurt because he trusts me with all of his heart. Well now, things are calmer but I'm so confused. Should I feel bad here or should he be handling this differently? How can we get through this and grow from it and work on being stronger together? HELP!!