What Happens When Treating Everyone Equally is Unequal?