In this economy, even the affluent are a ‘more cautious consumer,’ Sweetgreen CEO warns. Chipotle and Cava are hurting too