NYSE Euronext and Nasdaq are facing a backlash by mutual funds and securities regulators for offering trading tools that could harm some investors.