I agree with the general idea here that the music is brilliant but the lyrics are not so much. The story isn't amusing, just twee.
I might add that I found the "monster mouse" ending really confusing when I first had the album, because my LP was a cheap reissue without the lyrics on the inner sleeve. I couldn't understand the words leading up to it and there wasn't the explanation that it was the "cat's story."