Fix some issues with cards changing pixel format on-the-fly.

If a card came back with another pixel format than before,
we would still allocate frames with the same pixel format,
which obviously didn't work.

This is very unlikely to happen in the current situation
(or even impossible?), but needs to be fixed for upcoming patches.