I want to take a leave of absence

I am in a position where I can take a leave of absence,
but if I feel like I won't be able to return to work because I'll hate coming back once I've actually taken it,
should I just not do it?
I feel like it might feel like returning to base after military leave,
but I'm dying to take a leave of absence.