Shared festivals fail to unite castes because caste blocks common participation
Evidence
This is proved by the fact that the festivals observed by the different castes amongst the Hindus are the same. Yet these parallel performances of similar festivals by the different castes have not bound them into one integral whole. For that purpose what is necessary is for a man to share and participate in a common activity, so that the same emotions are aroused in him that animate the others. Making the individual a sharer or partner in the associated activity, so that he feels its success as his success, its failure as his failure, is the real thing that binds men and makes a society of them. The caste system prevents common activity; and by preventing common activity, it has prevented the Hindus from becoming a society with a unified life and a consciousness of its own being. — Ambedkar, B R, Annihilation of Caste_ The Annotated…, 877