Depending on how one looks at it, Pound could be either right or wrong. Thoreau's actions in no way show any apathy towards humanity. Pound could, however, be considered correct if you see that Thoreau's actions were in reaction to the increased industrialization of the world. He is in no way trying to make society feel inferior, but he is saying that the increased reliance on material and industrial goods is a detriment to the advancement of man's mind.
Society fascinates Thoreau. He describes seeing the birds and squirrels in the forest and talks about the similarities between the actions of the prairie dogs and the workers. To Thoreau, this was a reflection of the beauty and simplicity of nature that those in an industrialized world just couldn't understand. The village was not nearly as great as the pond or forest. He finds society to be interesting and all, but it becomes too complicated to understand, which is why nature is so much more appealing to him.
In "Economy", Thoreau discusses the problem of luxuries and material desires. He encourages humans to steer away from lavish desires, and he leads by example by building his house in a simple manner rather than having multiple floors and halls and rooms. He won't be stressing about paying back loans, making mortgage payments or