That's only true if you are buying from a business. If buying from an individual, you only have the right to return if there is a breach of contract such as the item received is not as was described. The advice from Which is quite useful.
However, as you say, any seller whether business or individual who wants to maintain their reputation would just accept it back, refund and move on.