When they finally explained that Kirito found out his parents weren't his real ones when he was ten, it totally clicked for me why he's always been so isolated; no wonder he clings to the virtual world, it's probably the only place he felt like he truly belonged after that kind of revelation.