Well, no plantation would ever feel like home to a slave, so there's that. But apart from that reason, the plantation did not really feel like a home to Douglass D. because his mother was dead.
She used to be with him at the plantation, but when she died, all of his connections to that place were simply gone with her.