I've recorded every book I've read* since December 2003. I used to do book reviews on here regularly, but have since stopped that for one reason or another. Still, I feel like I should tell you, my mythical reader, what's worth reading. So, by year, here are the books I've read that have been good. Note here the definition of "good" is "books you should consider reading even if you normally don't read books like that."
2004
Moneyball by Michael Lewis
Beyond Fear by Bruce Schneier
2005
An Empire of Wealth by John Steele Gordon (Americans only)
The Moon Is a Harsh Mistress by Robert Heinlein
Hyperion by Dan Simmons
2006
America's Game by Michael MacCambridge (Americans only)
The Cold War by John Lewis Gaddis
American Gods by Neil Gaiman
The American Revolution: A History by Gordon Wood
Dune by Frank Herbert
2007
The Price of Admission by Daniel Golden
Americanism by David Gelernter
2008
1491 by Charles Mann
The Fate of Africa by Martin Meredith
The Name of the Wind by Patrick Rothfuss (I violated my "don't read a series until it's done" rule for this book, and I don't hugely regret it)
These are far from the only books I read those years, but they're the only ones I can say really are good.