[CARBONDATA-4154] Fix various concurrent issues with clean files