The case is the first enforcement action brought under a state fiduciary rule that took effect in September that raised the investment-advice standard for brokers.