Add a couple of asserts to late join