I trust your comments come after having read a lot about the subject. They come across as parroting dog whistles and I really hope they are not.
In social sciences it is important to ask “but why” questions. You purport that inequalities may be tied to having fathers outside the main home.
If this is the problem (and I’m not agreeing with you) we need to get to the root cause, “but why are black fathers outside the home.” If you go down the “but why” tree, you will likely be confronted with "systemic racism (the true cause of pervasive inequalities)" - unequal access to quality education (why are schools funded the way they are?), unequal incarceration rates, unequal punishment from the “justice” system, unequal access to well-paying jobs, unequal access to quality housing, unequal built environments in white vs. black neighborhoods, health disparities not explained by socioeconomic status, insurance access, co-morbidity, or insurance, etc.
Again, I hope you’ve researched this topic and you’re not falling into racist tropes. I’m interested in what you’ve read, so please share so I can further my understanding!