If you get enough in one run, you can select one of multiple weapons/upgrades at the start of your next run. the selected weapon will spawn in the start room of every run after that (until you select something new).
I think they are also a currency in secret rooms? I never really found one, so I don't know but it was in the patch notes as far as I remember.