Since the building has been started the planning permission is extant, so you could finish off the building as shown on the plans submitted to the council.
Then it becomes a stable, but that type of building may not meet the definition of an agricultural building.

On the facts posted...