I think this is a fair comment. I'd say the thing they don't understand, or which they fail to recognize, is the damage racism causes. As a white person, I simply cannot comprehend being treated any other way than how a white person is treated. There's a level that I fundamentally expect to be there, just as I fundamentally expect the sun to rise in the morning.
There are people who fear the water because they had an experience where they almost drowned. I've seen adults try to take swimming lessons later in life who trembled with terror as they entered the pool. A person who has never almost drowned, will never understand that abject fear. Is that a fair way to put it?