If you want to build. Work up a 20 VT or 20 VTT and be happy.
If you want to buy. Purchase a 204Ruger in something like a Tinka or CZ and be happy. Both would serve you well as a varmint rifle. The smaller 20's would not heat as fast, if you were to do a lot of ground squirrel/PD shooting. Just a thought or two for you. Bill K