There should be a little number or visual indication if there is something new in there.

I keep missing comments from my team. There is no way to know if there are unread notifications in the notification unless you physically go in there & check.