Went to Lyme Regis and Chesil Beach a couple of years ago, and it was great. The great sweep of the pebbles is really fascinating, especially as they're all neatly graded by size by the sea! There's an unintentionally hilarious 'museum' in Lyme, with papier-mache dinosaurs - real Blue Peter stuff, but with some very nice fossils which one can buy.
The place is really Fossil City, but the main pub in town, which is also an inn and where we stayed (I've forgotten its name!) is very friendly. During the course of the evening, one of the regulars announced he was off to shoot a few bunnies. The chap I was with wondered if he'd bring him back a couple, which he duly did in exchange for a fiver, and we had delicious rabbit stew a few nights later! How despicably easily my stomach can overrule my heart!