Yes, I find myself doing the same. You just wonder about the many hands they've passed through and tills they've been in. Not to mention the countless pockets and purses, as well as the places they've been spent.
 
	Actually, to a certain extent you also wonder about the high grade specimens. Were they specially saved by the collectors of their day, or did they become lost in some drawer or down the back of an old settee, only to emerge more than a hundred years later?  I've a little personal theory on that one: I tend to think that if the edge is as lustrous as the faces of the coin, then they've been lost. If the edge is well toned as compared to the remainder of the coin, they've been collected, but have innumerable edge handling marks.