Does he even care about me?

If you like ex 1 then stop talking about ex2 and tell him you want to be with him. He obviously feels upset because your talking to your other ex. Good luck!