But when you say “we” need to confront how “we” allowed the enslavement of people’s does that include the enslaved? Did they allow it, too? Are they part of the “we” in that clause?
Anyone who has ever studied slavery, even cursorily, knows that the answer to that question is "yes". If you don't realize that the same person can both enslave and be enslaved in their lifetime, much of the world's history before the 20th century is going to be very confusing to you, and the history of places like Dahomey, Haiti, or the Choctaw Nation entirely incomprehensible.
We are all, also, inheritors of an ostensibly democratic government that did all these things, and
we have a collective responsibility to make amends and do better. If
we were to (for instance) institute a very belated system of reparations, it would come out of everyone's paychecks, not just white billionaires, so
we would all have to decide whether it is worth the cost to
us. It is
our government, and
we must make informed decisions about what it will do.