Update: So after almost 24 hours I had to peel the $5 note off the freezer packs, as I had placed water on both sides of the packs on damp bill. Even though the water runs off the plastic bill, it was stuck quite well, leaving only frozen water spots that wiped right off.
Digging into the bill with my nails, I really tried to tear it first on the corner with no success.
I even tried tearing it on the thinnest part, where the hologram plastic is, which did leave a small indent.
The polymer $5 bill completely survived the frozen torture test, with only nail or crinkle marks from where I really tried to tear it up!