On a DF bike, I always got away with lightweight aluminum wheels. But when I switched over to a V20 and S30, I started munching front wheels pretty regularly. I worked on my piloting, becoming more aware of wheel-eating holes and bumps, either avoiding them or slowing down in time, but I also switched over to carbon rims. They are so much stronger, without a weight penalty. The wheels on my Vendetta are coming up on three years, and I have not had to touch them with a spoke wrench. Same for the set on my Silvio, which are now two years old. Both sets are laced with 24 spokes up front and 20 in the back. Even with better piloting, hitting holes and bumps is inevitable, and these wheels have stayed true and round through it all.
I know that you said that you want to stay with more affordable aluminum for now, which I totally get, but for me ponying up for carbon has definitely been worth it.