Just my opinion, but I think you should be able to completely max out stats during the fighter build.
IE you shouldn't be limited to just putting in 110 points. If you want to dump 150 points into Jits, than go ahead. Maybe if you do that, take away some points from the fighter (since it's harder to train up, obviously, the better the fighter gets).