Millard Fillmore, Constructive Statesman door William Elliott Griffis