Survey data on life satisfaction is a reliable tool for
measuring some aspects of well-being. There is evidence (including in some research
reported on this blog) that survey measures of life satisfaction are closely related
to perceptions of achievement, personal relationships, standard of living,
links to community, health and future security. There is also evidence that when
people are asked to evaluate their life satisfaction they tend to think about
things such as their career, romantic life, family, standard of living and
health (See: Maike Luhmann et.al).
However, as previously discussed on this blog (here, here and here) there is a problem in comparing life satisfaction ratings from
surveys conducted at different times because reference norms do not remain
static. When we are asked to rate our satisfaction
with life we do so relative to reference norms, such as by comparing the
quality of our lives with those of people we know, or by comparing our current
lives with ‘the best possible life’. That means that we are rating our lives
against benchmarks that can change as a result of such things as technological
advances. For example, if we perceive that people living the best possible life
have access to useful communications devices, such as iPhones, we may rate our
own lives less highly if we cannot afford such devices.
If we see our lives improving in line with our perceptions
of the best possible life, it is hardly surprising if we give similar ratings
to their lives in successive surveys. It should be obvious that it would be a
mistake under those circumstances to interpret stable ratings as implying that
there has been no improvement in the quality of our lives. Before claiming that
people are on some kind of hedonic treadmill that requires them to run faster
to stay in the same place, researchers should be sure that the measurement
tools they are using are actually capable of measuring progress.
Similarly, when researchers see life satisfaction ratings return to
previous levels after people suffer some misfortune, they should be sure that they are using appropriate measurement tools before they claim that this means that
the people concerned have not experienced any lasting loss of well-being. It is
commendable and often therapeutic to “look on the bright side of life”, but if
life evaluations reflect frames of mind it may be problematic to interpret them
as a judgement about overall well-being.
That point can be illustrated by reference to a South
African study in which conventional life satisfaction and happiness ratings
were compared with scores on the ACSA scale. (See: Valerie Møller, Peter
Theuns, Ida Erstad and Jan Bernheim, ‘The Best and Worst Times of Life: Narratives and Assessments of subjective Well-Being by
Anamnestic Comparative Self Assessment (ACSA) in the Eastern Cape, South
Africa’, Soc Indic Res, 89(1) 2008.)
The ACSA approach to measuring well-being and changes in
well-being was first suggested by Jan Bernheim about 30 years ago. Its distinctive
feature is to ask survey respondents to rate their current well-being by
comparison with their memory of the best and worst periods of their own lives, with
the best period being given a rating of +5 and the worst period being given a
rating of -5. The scale is left open so that subsequent scores higher than +5
or lower than -5 are possible if individuals
consider that their lives have improved or deteriorated sufficiently.
The South African study involved 46 respondents, 20 of whom
were patients in a TB hospital. In general, the three measures of subjective
well-being were strongly correlated with each other, but there was weak correlation
between life satisfaction and ACSA for the TB patients. Again, while there were
no significant differences between the averages of conventional life
satisfaction and happiness ratings of the TB patients and others included in
the survey, on the ACSA scale the average ratings of the TB patients were about
30 per cent lower than for the others included in the survey.
The authors note that while they did not ask for life
stories when they were obtaining ACSA scores, they observed that respondents
tended to string the momentous events in their lives together, using anchor
periods as reference points to shape a coherent narrative. Interviews lasted
between half an hour and 45 minutes and respondents “generally had no
difficulty with the task”.
A couple of years ago I wrote a post wondering why more use
has not been made of ACSA. I am still wondering. It seems to me that it would
be potentially useful to incorporate an ACSA question for a sub-sample of
respondents whose well-being has been monitored over an extended period in
longitudinal studies (such as GSOEP, HILDA and BHPS). The accounts of changes
in well-being over time provided by those surveys would be more plausible if
life evaluations were anchored to consistent reference points corresponding to
the best and worst periods of the lives of respondents.