City brokers have been bullish about the Lloyds Banking Group share price for the past few years. But that might be changing.