It is nearly always best not to clean coins (esp if you have just started the hobby). If you have brought a good album from a reputable brand, then the coins shouldn't react with the plastic. (Cleaning is not going to stop any potential reaction anyway.)
In theory, a gentle wipe with a lens cloth is fine if the cloth is very clean. However, if there is any grit on the cloth, then your coins will end up with hairlines (i.e. ruined).
So just put them in the album and enjoy!