Fix an issue where we'd add an unneeded bounce for mipmaps in some cases.