Should I be worried about this?

You need to talk to him. You really need to speak to him about this. Tell him that you saw it and you're worried. That's really the best thing to do.