I've noticed the same thing. My front fender is getting pretty dirty on the sides. With glossy paint I'd be aggressively cleaning but I'm not sure how to clean the matte white.
Soaking affected areas with warm wet towels works well for bug removal.
For routine bike washes I use Chemical Guys matte paint wash. Just a few drops in a bucket is all that's needed