I think you are right to be concerned. Not freaked out hopefully, but concerned for sure... and yes, at least document it, and if possible, do some casual digging to figure out who he is, as sevenofnine suggested. Not so much for retribution just for your safety.