You can unlock the Elven Garden after clearing Main Story 3-20 and have a character created for over 48hours.