Luxury brands hiked up their prices about 20% between 2021 and 2023, steering off middle-income shoppers facing financial pressure.