You're free to set this event whenever you want in May; the Labyrinth was the May event. As for getting rid of her, I could arrange to have an NPC remove her if one of the characters requested it.