Obligatory Hank Schrader from Breaking Bad:

They're rocks, Hank!
No, they're minerals! Jesus, Marie!

If you ever wondered about the distinction, you should watch this video (3 min 31 s) from the American Museum of Natural History which does a great job explaining the difference between crystals, minerals, rocks and gems.