Had the Puritan persecution of dissidents been consistent, the Quakers and Baptists likely wouldn’t have survived. Instead, it came in waves aimed more at the traveling missionaries as well as to constrain the political and business prowess of resident Friends.
Further, there were relatively few congregations or ministers in New England. Despite required attendance at worship on the Sabbath, the buildings couldn’t hold them all, had they showed up.
Who was keeping attendance rolls, anyway?