Quantitative storytelling is a systematic approach used to explore the multiplicity of frames potentially legitimate in a scientific study or controversy. QST assumes that in an interconnected society multiple frameworks and worldviews are legitimately upheld by different entities and social actors. QST looks critically on models used in evidence-based policy. Such models are often in the form of risk analyses or cost benefit analyses, and necessarily focus on a single framing of the issue under consideration. QST suggests corrective approaches to this practice.
Context
Quantitative storytelling addresses evidence based policy and can be considered as a reaction to a style of quantification based on cost benefit or risk analysis which—in the opinion of QST proponents—may contain important implicit normative assumptions. In the logic of QST, a single quantification corresponding to a single view of what the problem is runs the risk of distracting from what could be alternative readings. Alternative frames may represent ‘uncomfortable knowledge’, which is removed from the policy discourse. Thus, extensive mathematical modelling in EBP to support a given policy may lead to a simplification of the available perceptions and generate—rather than resolve—controversies. The word ‘hypo-cognition’ has been used in the context of these instrumental uses of frames. Under this critical viewpoint, mathematical models can be seen as a tool for ‘displacement’. Displacement occurs where a model becomes the end instead of the tool, e.g. when an institution chooses to monitor and manage the outcome of a model rather than what happens in reality. Once exposed, the strategic use of hypo-cognition erodes the trust in the involved actors and institutions.
Approach
QST suggests acknowledging ignorance, as to work out ‘clumsy solutions’, which may accommodate unshared epistemological or ethical principles. This is in turn close to the PNS suggested style of inquiry known as ‘working deliberatively within imperfections’, and to the exigence for a ‘rediscovery of ignorance’. QST also calls attention to the power relationships at play in the use of evidence. Saltelli and Giampietro suggest that our present approach to evidence-based policy, even in the more nuanced formulation of evidence-informed policy, requires our urgent attention. Unavoidable asymmetries are generated by the fact that stronger players have access to better evidence, and can use it strategically. The decline of pollinators challenge show that interest groups have more scope to capture regulators than the average citizen ad consumer. QST encourages an effort in the pre-analytic, pre-quantitative phase of the analysis to map a socially robust universe of possible frames. QST expands on one of the rulessensitivity auditing by asking the question of ‘what to do’ in order to avoid that an issue is framed unilaterally. Obviously, the medicine for a diseased evidence-based policy is not a prejudice- or superstition-based policy, but a more democratic and dialogic access to the provision of evidence—even in terms of agenda setting. For this a new institutional setting is needed. QST does not eschew the use quantitative tools altogether. It suggests instead to explore quantitatively multiple narratives, avoiding spurious accuracy and focusing on some salient features of the selected stories. Rather than attempting to amass evidence in support of a given reading or policy, or to optimise it with modelling, QST operates ‘via negativa’, i.e. it tries to test whether the said framing runs afoul of a quantitative or qualitative analytical check. Here QST borrows from system ecology and attempts to refute whether or not the frames violate constraints of :
feasibility
viability
desirability.
Applications
Perhaps the best application of the concept of QST is an old study of GMO-related perceptions, which has lost very little of its actuality since the ongoing GMO and pesticide debate. By direct interview and measurements of stakeholders’ expectation and worldviews, Marris and co-authors showed that the prevailing narrative of the reaction to GMO as a ‘food scare’—i.e. as an issue of safety to consume GMO food—did not show up among the concerns raised by the interviewed citizens, which worried instead about who would benefit from these technologies, why were they introduced in the first place and whether existing regulatory authorities would be up to the task of resisting regulatory capture from powerful industrial incumbents. A more recent instructive application of QST exploring the transition to intermittent electrical energy supply in Germany and Spain is due to Renner and Giampietro. Other applications of approaches which can be referred to QST are to the analyses for the cost of climate change, to the controversy surrounding the OECD-PISA study), to food security, to the controversy surrounding the use of Golden Rice, a GMO crop, and to the ecological footprint of the Ecological Footprint Network.
