Why do I even try with him?

Due to work schedules I hadn't seen my boyfriend since late at night on his birthday 3 days ago. He was drunk and ped out about an hour after I was there. I had to leave early the next morning and didn't wake him. I wanted to make up his birthday so today I went out shopping for him and bought him a new outfit and made reservations at a nice restaurant and told him not to make any plans that I had something special planned for the two of us and I wanted to spend the whole day alone together because it will be a few more days before we see each other again. Anyways.... I get over to his house and give him his gifts. He got mad at me for buying him clothes and not getting him cash. I told him to return them and keep the refund then. When he asked where we were going for dinner I told him and he said he hates the place and didn't want to go. We ended up going elsewhere and still had a pretty good time. We get back to his house and I was in the mood and tried kissing on his neck to heat things up when his phone rings and it's his friend. I am working 3rd shift tonight so I had to leave at 10:30 and it was 9:00 when his friend called. He invited his friend over and I was really upset that I hadn't seen him in a few days and he knew I wanted to be alone with him until I had to leave for work. When I left he didn't even act as if he realized I was upset. About an hour ago he calls me to tell me he's goin' to bed soon and since I was kinda mad at him it showed in my tone I guess because I was really short with him and told him "ok goodnight" then he said wait I want to talk a little bit first. I said in quote " well I wanted to be with you tonight" thats all i said and he hung up on me. I called him back and he wouldn't answer. Then he sends me a text message saying in quote "I think it's shitty that your mad at me for not puttin' out" This took me by surprise because I couldn't believe he would actually think that it was just about the . I tried to make this a great day for him and it totally blew up in my face. Would I be in the right to want to end this relationship because I feel very unappreciated?