I’d gladly go once a year for a couple of weeks, but barring any extenuating circumstances, and when money’s tight, other plans win out.

I would gladly go there every year for a couple of weeks, but if there's nothing pressing and I'm short of money, other plans take priority.

I'd come for a couple of weeks once a year with pleasure. But when there's no pressing need and you're short of money, you have to give preference to the other plans.