You can use one early on, but once the timer hits 40-35 or so, you want to start saving them up so that you have as many to use under buffs as possible.
When in doubt, it's free to wait on them and see where the cooldown is compared to your Wanderer's Minuet cooldown timer, if you are going to cap Heartbreak around the same time (or before) WM comes back, fire one off.