Even a radical Hindu reform group cancelled Ambedkar over his anti-Shastra stance

Evidence

Annihilation of Caste is the text of a speech Ambedkar was supposed to deliver in Lahore in 1936 to an audience of privileged-caste Hindus. The organisation that had been bold enough to invite him to deliver its presidential address was the Jat-Pat Todak Mandal (Forum for Break-up of Caste) of Lahore, a ‘radical’ offshoot of the Arya Samaj. Most of its members were privileged-caste Hindu reformers. They asked to be provided the text of the speech in advance, so that they could print and distribute it. When they read it and realised that Ambedkar was going to launch an intellectual assault on the Vedas and shastras, on Hinduism itself, they wrote to him: [T]hose of us who would like to see the conference terminate without any untoward incident would prefer that at least the word ‘Veda’ be left out for the time being. — Ambedkar, B R, Annihilation of Caste_ The Annotated…, 135