Also check the positive connection ON the starter itself. I've had more than one of these come loose and cause exactly what you're describing.
Disconnect the battery first, though!! You can throw some serious sparks if you forget...
Disconnect the battery first, though!! You can throw some serious sparks if you forget...