I turned the Hush House into a House of Memories.
On my second run and I play without using the wiki.
I have been organizing the books based on the memories they generate and I use where they are in the house and what items they are next to help me remember what memory they generated. The Moment of Regent is by an egg. The memory that generate Sky and Scale is in the observatory by the Hourglass. Books of satisfaction are in the pantry. Ect.
So books are organized by Memories but the house is used as my own house/palace of memories for the Memories of the books.