You do have to choose what item you would like to purchase in game and this choice cannot normally be refunded or reversed, so choose wisely!
There is no time limit for spending your HeroPoints so make sure you are taking your time to choose your item.