Anti-Federalists opposed federal militia control as a path to tyranny.

Evidence

After the militia clauses made it into the draft, however, the trouble started with just a few days remaining in the Constitutional Convention. The strongest objection came from the Anti-Federalists—in both the North and the South—who rejected the idea of a stronger central government. They argued against congressional control of the militia, believing that it was the pathway to a standing army, tyranny, and the destruction of democracy. — Nikole Hannah-Jones et al., The 1619 Project, 786