Ron Paul, a strict libertarian, is actually the third most liberal Republican in the House (behind only Chris Shays and turncoat Rodney Alexander whose voting score is due to his time as a Democrat). Hagel, on the other hand, scores around 7% on Progressive Punch. The rest of his votes are pretty horrible.
I would be a little easier on Paul and a lot harder on Hagel.