“The vote being passed, altho' further observn on it was out of order, he could not refrain from rising and expressing his satisfaction and concluded by saying "there is but one word, Mr. President, in the paper which I disapprove, & that is the word Congress," on which Ben Harrison rose and said "there is but on word in the paper, Mr. President, of which I approve, and that is the word Congress.”

“We are afraid of the known and afraid of the unknown. That is our daily life and in that there is no hope, and therefore every form of philosophy, every form of theological concept, is merely an escape from the actual reality of what is. All outward forms of change brought about by wars, revolutions, reformations, laws and ideologies have failed completely to change the basic nature of man and therefore of society.”

“There is a natural aristocracy among men. The grounds of this are virtue and talents.”

“Rightful liberty is unobstructed action according to our will within limits drawn around us by the equal rights of others. I do not add 'within the limits of the law' because law is often but the tyrant's will, and always so when it violates the rights of the individual.”

“If you want something you’ve never had, you’ve got to do something you’ve never done before.”

“The rich alone use imported articles, and on these alone the whole taxes of the General Government are levied...and its surplus applied to canals, roads, schools, etc., the farmer will see his government supported, his children educated, and the face of his country made a paradise by the contributions of the rich alone, without his being called on to spend a cent from his earnings.”

“Some men look at constitutions with sanctimonious reverence, and deem them like the ark of the covenant, too sacred to be touched. They ascribe to the men of the preceding age a wisdom more than human, and suppose what they did to be beyond amendment. I knew that age well; I belonged to it, and labored with it. It deserved well of its country. It was very like the present, but without the experience of the present; and forty years of experience in government is worth a century of book-reading; and this they would say themselves, were they to rise from the dead. I am certainly not an advocate for frequent and untried changes in laws and constitutions. I think moderate imperfections had better be borne with; because, when once known, we accommodate ourselves to them, and find practical means of correcting their ill effects. But I know also, that laws and institutions must go hand in hand with the progress of the human mind. As that becomes more developed, more enlightened, as new discoveries are made, new truths disclosed, and manners and opinions change with the change of circumstances, institutions must advance also, and keep pace with the times. We might as well require a man to wear still the coat which fitted him when a boy, as civilized society to remain ever under the regimen of their barbarous ancestors.” 

“The art of life is the art of avoiding pain.”

“our civil rights have no dependance on our religious opinions, any more than our opinions in physics or geometry; that therefore the proscribing any citizen as unworthy the public confidence by laying upon him an incapacity of being called to offices of trust and emolument, unless he profess or renounce this or that religious opinion, is depriving him injuriously of those privileges and advantages to which, in common with his fellow citizens, he has a natural right; that it tends also to corrupt the principles of that very religion it is meant to encourage,”

“I am certainly not an advocate for frequent and untried changes in laws and constitutions...but I know also that laws and constitutions must go hand in hand with the progress of the human mind.....”

“Neither Pagan nor Mahamedan nor Jew ought to be excluded from the civil rights of the Commonwealth because of his religion. -quoting John Locke's argument.”

“The principle of spending money to be paid by posterity, under the name of funding, is but swindling futurity on a large scale.”

“[n regard to Jesus believing himself inspired] This belief carried no more personal imputation than the belief of Socrates that he was under the care and admonition of a guardian demon. And how many of our wisest men still believe in the reality of these inspirations while perfectly sane on all other subjects (Works, Vol. iv, p. 327).”

“The laws that forbid the carrying of arms... disarm only those who are neither inclined nor determined to commit crimes.”

“To the corruptions of christianity I am indeed opposed; but not to the genuine precepts of Jesus himself. I am a Christian in the only sense in which he wished any one to be; sincerely attached to his doctrines, in preference to all others; ascribing to himself every human excellence, and believing he never claimed any other.”