I havent called my boyfriend in 3 days!?

My boyfriend was out at his cabin this past weekend. He told me to call so I did but he sounded busy with family so I told him Id call him back this week. He didnt sound happy & asked me why. I guess i did wrong by saying, because Im watching my movie & Im not really talking about anything. I didnt want him to think hes a problem. & I dont want to be a problem. Well, I called him today & he wouldnt answer. During the week hes sometimes really busy. Tue & Thur-Baseball. Most other days? Swimming at around six o clock. Did I do something wrong? Should I not call him this week? WHAT SHOULD I DO?!!! ADVICE PLEASE...