I am not saying don't improve it, only that really big changes often do not have the effect you want.
For instance, when I was younger, the common upgrade to a car was to put overload spring shocks on, to lift the back and stiffen the spring rate. It looked and worked cool for the first few days, until the shock mounts broke from the added stress.
Ever see the lowered Honda's, bouncing their suspensions against the stop. Destroys the suspendion arms and bushing pretty quick. Lowering a car needs more engineering then cutting a couple of loops off the springs.
Same with the bike. The frame is flexible, the frame size and strength were designed around the forces that the forks provide. So when you hit a pot hole, the forks flex, absorbing some shock, and the steering neck moves a little. Now upgrade to a much better fork. Thicker, stronger downtubes, stiffer valving. Now when you hit a pot hole or bump, the fork do not flex, sending much more force to the steering neck. While it probably won't snap "today", the increase forces and flexing will fatigue the welds around the neck and possible cause a failure of the steering neck.
I am not guaranteeing this, only saying there is more to improving the bike than just stiffer shocks and a bigger fork....You have to look at the whole system. Some bikes are over built, and the upgrade is within the ability of the system to handle it. But most bikes are not so robust, so changes like that have unintended consequences.
That's why stuffing a 350cc motor in that 100cc frame doesn;t work...the frame can't handle the power and torque....
XB is very knowledgeable and experienced, and as full of finess as a 5 lb sledge....but he is pretty much on the mark.
Try another method. You would be surprised how much better a bike handles when the wheels are true and spokes properly tightened. I know from my own bike, the single biggest improvement from handling came not from tapered bearings, right size tires, new bushing in the fork, but from straight wheels with strong, properly tightened spokes. I neglected getting that right in the past and fought a wobble for years.
Get the steering stem right, forks straight in the clamps, true and tighten wheel spokes, it may surprise you at the improvement. Have you ever checked the wheel run out?