Is my employer allowed to text me outside of work on non-work related matters to call me an idiot?

My employer recently started texting me to give me information on where to go and when for the next day, which is fine. However, recently he texted me blaming me for something that happened in the store after I had left, and, just to clarify, I asked him when the incident occurred. Instead he began berating me about my intelligence and told me to look up the Abbot & Costello "Who's On First" skit to essentially deliver commentary on my ability to interpret communication. What I'm wondering is if this constitutes as harassment or something similar. If not, then I'm not sure how long I'll be able to put up with being told how stupid I am at work and outside of it.