The financial firms are all trying to hitch their wagons to a fast-growing area of the market that can generate hefty fees. They are also adjusting to a fundamental economic shift in which more companies have delayed or forgone public listings while nonbank lending has expanded.