IDEAS home Printed from
MyIDEAS: Log in (now much improved!) to save this paper

FoolWatch: A Case study of econometric analysis and evidenced-based-policy making in the Australian Government

Listed author(s):
  • Harding, Don

The decision to introduce a national FuelWatch scheme provides a timely case study of `evidence-based- policy' making in Australia. The government based its decision on econometric work by the ACCC who refuse to release the data. They claim that their analysis is robust because it has been subject to scrutiny within the ACCC and by Treasury. Experience with `evidence based policy' making in the United Kingdom (UK) raises doubts about such claims. The UK experience led to the term `policy-based-evidence' to describe the end result where government agencies filtered out information that was inconsistent with government policy. The data used by the ACCC can be digitized from a graph in their report. I then use the data so obtained to assess the robustness of the ACCC analysis and econometrics. Since the government and their advisors did not realize that the data could be obtained in this way it provides a `natural experiment' in which their claims can be evaluated and tested. I find that the ACCC apply the wrong tests to the wrong variable. Specifically, they study the nominal retail margin when economic theory suggests that analysis of anything but the real retail margin to producers creates a misspecified model inconsistent with the econometric assumptions used. The econometrics in Appendix S of the ACCC report on petrol is substandard in application of techniques and in reporting of what was done. This should not be seen as an adverse reflection on the econometricians employed by the ACCC. Rather, it is a reflection on the process through which their work is incorporated into reports and used by government. The ACCC findings are not robust. When I apply the correct version of the procedures used by the ACCC to the correct variable I find that the data does not support the original ACCC finding. Specifically, it is not possible to conclude as the ACCC did that FuelWatch did not raise petrol prices in Western Australia. FuelWatch of itself is unimportant. The important issues here relate to the integrity of the government's `evidence-based' approach to policy. The UK experience clearly shows that relying on the untested opinion of `experts' leads to fudging' of the evidence or overstatement of the conclusions that can be supported by the data. This ultimately corrupts the evidence-based-policy approach. The FuelWatch experience shows that these dangers are present for Australian policy makers. Greater transparency by government, publication of data and analysis underpinning government decisions and independent review of econometric work are the only protections against this danger. Failure to implement these protections will invalidate claims about the evidence base of future policy decisions.

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL:
File Function: original version
Download Restriction: no

Paper provided by University Library of Munich, Germany in its series MPRA Paper with number 16041.

in new window

Date of creation: 01 Jul 2008
Handle: RePEc:pra:mprapa:16041
Contact details of provider: Postal:
Ludwigstra├če 33, D-80539 Munich, Germany

Phone: +49-(0)89-2180-2459
Fax: +49-(0)89-2180-992459
Web page:

More information through EDIRC

No references listed on IDEAS
You can help add them by filling out this form.

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:16041. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Joachim Winter)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.