Consumer confidence is still in the right direction despite a fall