Berry told authorities that she, her child and the other women never saw a doctor during their captivity. Knight, now 32, said her five pregnancies ended after Castro starved and repeatedly punched her.
The women escaped Castro's house May 6 when one of them kicked out part of a door and called to neighbors for help. Castro was arrested within hours and has remained behind bars.
Residents of the street where Castro's boarded-up house is surrounded by a tall chain-link security fence welcomed the guilty plea and the news that the house likely would be torn down within a month, possibly to make way for a park.
"It's really horrifying to look at and for my kids to see," said De'Andrea Harris, who lives directly across the street with her two children. She said she had no idea anything was wrong in the house until the women were rescued.
"So I just can't wait until they tear the house down so everything can be over," she said.
Castro's uncle, Julio Castro, who has run a nearby corner store for 44 years, said the ordeal will be with him and his family members the rest of their lives.
"He's getting what he deserves," Castro, 77, said. "Nobody has the right to incarcerate you for 10 years."
Another neighbor on the street where many residents are also from Puerto Rico, said Castro had seemed to be a good neighbor before the women escaped.
"We never, the neighborhood, realized that he had those girls there," Aurora Marti, 75, said in Spanish. "He would come out, greeted me, we would talk for a bit here or in front of the door, and that's it."
She said she knows Castro's mother, "and she's suffering a lot."
Castro had been scheduled for trial Aug. 5 on a 977-count indictment, but 40 counts were dropped as part of the plea deal. The indictment included two counts of aggravated murder related to accusations that he caused the miscarriages. The former school bus driver also was charged with hundreds of counts of kidnapping and rape, plus assault and other counts.
The sticking point on a plea deal had been if the prosecutor would rule out the death penalty.
Prosecutors will recommend at the sentencing hearing that Castro have no contact with the girl he fathered. McGinty said there's "zero chance" he'll ever be allowed to see the girl.
McGinty said the county will use more than $20,000 seized from Castro to tear down his house within a month, and two abandoned houses next door will be razed and a vacant lot acquired for a park.
The prosecutor rejected attempts by Castro to portray himself a victim of a sex addiction.
"He's a coward and he's nowhere near the truth," McGinty said. "He's in his own world and it's not a world of regret and remorse. He feels sorry for one person and one person only -- himself."