FoolWatch: A Case study of econometric analysis and evidenced-based-policy making in the Australian Government
AbstractThe decision to introduce a national FuelWatch scheme provides a timely case study of `evidence-based- policy' making in Australia. The government based its decision on econometric work by the ACCC who refuse to release the data. They claim that their analysis is robust because it has been subject to scrutiny within the ACCC and by Treasury. Experience with `evidence based policy' making in the United Kingdom (UK) raises doubts about such claims. The UK experience led to the term `policy-based-evidence' to describe the end result where government agencies filtered out information that was inconsistent with government policy. The data used by the ACCC can be digitized from a graph in their report. I then use the data so obtained to assess the robustness of the ACCC analysis and econometrics. Since the government and their advisors did not realize that the data could be obtained in this way it provides a `natural experiment' in which their claims can be evaluated and tested. I find that the ACCC apply the wrong tests to the wrong variable. Specifically, they study the nominal retail margin when economic theory suggests that analysis of anything but the real retail margin to producers creates a misspecified model inconsistent with the econometric assumptions used. The econometrics in Appendix S of the ACCC report on petrol is substandard in application of techniques and in reporting of what was done. This should not be seen as an adverse reflection on the econometricians employed by the ACCC. Rather, it is a reflection on the process through which their work is incorporated into reports and used by government. The ACCC findings are not robust. When I apply the correct version of the procedures used by the ACCC to the correct variable I find that the data does not support the original ACCC finding. Specifically, it is not possible to conclude as the ACCC did that FuelWatch did not raise petrol prices in Western Australia. FuelWatch of itself is unimportant. The important issues here relate to the integrity of the government's `evidence-based' approach to policy. The UK experience clearly shows that relying on the untested opinion of `experts' leads to fudging' of the evidence or overstatement of the conclusions that can be supported by the data. This ultimately corrupts the evidence-based-policy approach. The FuelWatch experience shows that these dangers are present for Australian policy makers. Greater transparency by government, publication of data and analysis underpinning government decisions and independent review of econometric work are the only protections against this danger. Failure to implement these protections will invalidate claims about the evidence base of future policy decisions.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by University Library of Munich, Germany in its series MPRA Paper with number 16041.
Date of creation: 01 Jul 2008
Date of revision:
Evidence based policy; Policy based evidence; Fuelwatch; petrol pricing; Econometrics and public policy;
Find related papers by JEL classification:
- D18 - Microeconomics - - Household Behavior - - - Consumer Protection
- L11 - Industrial Organization - - Market Structure, Firm Strategy, and Market Performance - - - Production, Pricing, and Market Structure; Size Distribution of Firms
- C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models &bull Diffusion Processes
- D43 - Microeconomics - - Market Structure and Pricing - - - Oligopoly and Other Forms of Market Imperfection
- C01 - Mathematical and Quantitative Methods - - General - - - Econometrics
You can help add them by filling out this form.
CitEc Project, subscribe to its RSS feed for this item.
- Don Harding, 2008.
"Fuel Watch: Evidence-Based-Policy Or Policy-Based-Evidence?,"
Economic Papers, The Economic Society of Australia,
The Economic Society of Australia, vol. 27(4), pages 315-328, December.
- Harding, Don, 2008. "FuelWatch: evidence-based-policy or policy based evidence?," MPRA Paper 16049, University Library of Munich, Germany.
- Harding, Don, 2008. "FoolWatch - Further Discussion of Econometric Analysis Undertaken By ACCC," MPRA Paper 16048, University Library of Munich, Germany.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Ekkehart Schlicht).
If references are entirely missing, you can add them using this form.