Both the tile map layers and the debug navigation canvas items did fight for the same z order causing a lot of flickering in certain situations.