"Well, I'm sure you have other folks to spend your time with. I don't want to be a bother."

He means it. He's not self-conscious about himself, necessarily, but he knows that it can be trying to constantly explain or teach or otherwise deal with the fact that he's missing things in the general knowledge base that most people of this age have.