A number of presidential libraries have placed archives of correspondence, speeches, oral histories, memoranda, and other materials online. Here are are few to try:
This archive of presidential speches offers both transcriptions and, for the 29th century, sound and audio files. Also features oral history interviews with figures from the Carter, Reagan, Bush I, and Clinton administrations.