Why is the speaker in his library when the poem, "The Raven" by Edgar Allan Poe, begins?

The speaker has been grieving the loss of his loved one, Lenore, and he's totally exhausted from it all. He's in his library to try to distract himself for a short while from his grief by reading. He falls asleep and wakes up at midnight when he hears a sound at the door.