then don't lean over on the patches with sand/gravel.
stand up and grab the bike between the knees.
if it's that bad, maybe lower the rear suspension somewhat with less preload?
might be your bike is loaded too much up front.
for mx in deep sand,i also need to lower the rear (or up the front) to get more stability.
see how this helps out.