Welcome to the forum.
My advice would be to collect a specific denomination of coin, not try and collect one of every date and denomination from the Victorian era.That would be a mind bogglingly long project. Pennies are very popular, as there are many varieties, and you can set your own specific parameters as to how far you go in variety specialisation.
I 100% agree with the remarks made above about buying higher grade coins - in fact the highest you can afford. You will not regret it, as they are a good investment, and you can always re-sell. Whereas you can't always with lower grade coins. That said, you may well have to take a hit on grade with very rare types, as not only are they extremely expensive in high grade, but in some cases, not ever to be found.
Good luck.