Height is trait that can easily be manipulated through sexual selection, with the given that an "adequate diet" is available so that near full genetic expression is possible.
There are many such traits in animals that are easily manipulated.
All one has to do is look at dogs and one can see how external traits can be manipulated.
Average heights of any group are just the result of random chance, a combination of sexual selection with available nutrition over time.
These external traits have to be contrasted with things like functional systems, like the mammalian visual system, something that has changed very little in millions of years.
And another such system is the human cognitive system.
Not a trait, like height, easily manipulated by sexual selection.
I think that this is overly simplistic. First, to be clear, sexual selection is the antithesis of "random chance" (depending, I suppose, on how one defines "random chance"). I am not aware of any evidence for selection favouring taller or shorter humans in specific areas, but I have no
a priori reason to reject the hypothesis that such selection occurred in the past.
Second, body size is an important trait, correlated with many other traits, and it certainly is "functional" (again, depending on how one defines "functional"). I would also warn against classifying traits as 'external' or 'internal'.
That being said, your basic point is valid: many traits are complex and constrained, and so tend to resist selection much more than simpler, less constrained traits. This does not mean that our visual systems or cognitive systems cannot evolve, indeed the evidence is that cognitive systems at least have evolved substantially over the past few million years.
The important point is that we have no good evidence that cognition has evolved differences among human subgroups. Personally I am open to the possibility that there are subtle average genetic differences in various aspects of cognition among groups of humans, but I see absolutely no good evidence that this is the case, and the efforts I have seen to promote the hypothesis that there are such differences have been infantile.
Peez