we loved the drive from from kernville as it followed the kern river into the mountains and through to porterville.
you will see giant trees this way without going further into the park but not as big as in the giants village.big enough though and in some ways we enjoyed the 100 giants trial more as it's much more secluded and less visited,so yes if you did'nt have the time or want to rush, missing the three rivers [generals highway] is an option.
if you want scroll down this page and you will find some pics of what it's like around this area. the next page will "take you" to the general sherman tree. have fun