It’s not about inflation or the economy — the election instead delivered a ‘wake-up call’ on affordability politics, top pollster says