Your argument is that the differences in environment are much greater between the groups than within the groups, therefore environment has a bigger role than genetics, and you speculate that this is one reason why the experts favor environmentalism over hereditarianism concerning the race-IQ gaps, as reflected in the 52 signatures. I have seen such an argument reported in popular media (i.e. Malcolm Gladwell) but not in academia (if such an argument exists in academia, I would like to know). The fallacy is overlooking the fact that differences in IQ is a strong causal force for differences in environment such as SES (most certainly within any race and plausibly between them). So nobody should think that IQ and SES are independent variables as though you can control for one and get the causal effect of the other. Herrnstein and Murray actually statistically demonstrated that a child born with a high IQ and typical SES has a much higher chance of becoming a wealthy adult than a child born with a typical IQ and wealthy parents. There have been many academic criticisms of the book
The Bell Curve, but nobody has challenged this salient point. It follows directly from the data.
The list of people included in the "52 Signatories" article include not only Linda Gottfredson but also Arthur Jensen, J. Philippe Rushton, and Richard Lynn. They are the leading figures of scientific racism concerning intelligence. Rational people on either side of the fence can agree on the uncertainty of their own conclusions.
A couple of things. First, SES is a very poor and imprecise measure of anything other than income itself, and captures only a tiny fraction of the variance in "environment".
Second, just like with the IQ-heritability relationship, models that predict future income from current IQ (thus indicating a causal impact) are driven by within-group variance for each of those variables, thus cannot speak to their relationship between groups. Because within group variance in environment in less extreme than between groups, this inherently inflates any relationship between non-environmental factors like IQ and future SES. Variance in being barred from good schools and threatened with murder for trying to improve your situation were and are tied to race in ways that are independent from SES and from IQ, yet is a variable that impedes the causal impact that IQ can have on SES.
Put another way, a black man and a white man in 1960 Alabama with equally high IQs and the same modest SES will have completely different future incomes, because the black man might get hung if he reveals his intellect or tries to improve his situation by applying it.
Also, the black person today along with their parents and grandparents and almost everyone in their community lives in a sub-culture (not defined by SES) in which most of the people around them come from 500 years of ancestors in which showing one's intellect got your killed and/or they were prohibited from most opportunities to apply that to improve their financial situation.
Those environmental causal factors are still fully in place, regardless whether the black person is born into a poor family or a middle class family.
Contrast this with two white people in the US from similar SES. They are both highly and equally free to apply their intellect to improve their future earnings and are likely to exist in a sub-culture where most people have been free to do so, and come from generations that were free to do so, especially relative to black slaves. Thus, differences in the intellect among whites was free to be applied and thus impacts future income to a much larger degree than for blacks. Thus, differences in IQ between blacks and whites are less of a causal factor in future income than they are between people who share the same race.