Problems in evaluating accuracy and consistency of macroeconomic forecasts

  • Received March 2, 2018;
    Accepted April 18, 2018;
    Published May 4, 2018
  • Author(s)
    Zhasser A. Jarkinbayev
    ORCID Researcher ID ,
    Aigul Kosherbayeva
    ORCID Researcher ID
  • DOI
    http://dx.doi.org/10.21511/ppm.16(2).2018.10
  • Article Info
    Volume 16 2018, Issue #2, pp. 102-112
  • TO CITE АНОТАЦІЯ
  • Cited by
    2 articles
  • 1143 Views
  • 307 Downloads

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License

The paper focuses on the analysis of the quality of macroeconomic forecasts, as well as on general issues of the functioning of the system of macroeconomic forecasting in the Republic of Kazakhstan. It provides a comparative analysis of errors of initial and revised macroeconomic forecasts of the real sector of economy indicators. To assess forecast accuracy, the authors use the world’s most widespread measures, such as the mean error and the mean absolute percentage error, as well as official statistical data and records. The overall forecast consistency and congruence of assumptions on the dynamics of indicators of the real sector and fiscal policy are estimated using the basic identities of the System of National Accounts. The paper also considers institutional aspects of the system of macroeconomic forecasting in the Republic of Kazakhstan. The authors conclude that revised forecasts, with the exception of monetary policy indicators, exhibit a smaller error, which can indicate a need for greater coordination of public authorities in the process of preparing forecasts, developing the system of independent assessment of their quality and improving their transparency.

view full abstract hide full abstract
    • Figure 1. Forecast and actual values of real GDP growth, %
    • Table 1. Errors in the forecast of the real sector of economy, pp.
    • Table 2. Errors in the forecast of monetary statistics indicators, pp.
    • Table 3. Errors in the forecast of the government budget indicators, pp.
    • Table 4. Correlation coefficients of forecast errors for 2002–2016
    • Table 5. Forecast indicators for 2018
    • Table 6. Indicators of net lending/borrowing, trillion tenge
    • Andryakov, A., Gurvich, E., & Chernyavsky, A. (2006). Harmonization of Macroeconomic Forecasts in the Methodology of the System of National Accounts. Voprosy Ekonomiki, 8, 65-81.
    • Banco de España (2006). The analysis of the Spanish economy. Data, instruments and procedures.
    • Bank of England (2015). Evaluating forecast performance. Independent Evaluation Office.
    • Barker, K. (2012). Macroeconomic policy: Too much autonomy and too little coordination. CentreForum.
    • Bogaert, H., Dobbelaere, L., Hertveldt, B., & Lebrun, I. (2006). Fiscal councils, independent forecasts and the budgetary process: Lessons from the Belgian case. Federal Planning Bureau.
    • Bratu, M. (2012). The reduction of uncertainty in making decisions by evaluating the macroeconomic forecasts performance in Romania. Economic Research – Ekonomska istraživanja, 2, 239-262.
    • Chen, C., Twycross, J., Garibaldi, J. M. (2017) A new accuracy measure based on bounded relative error for time series forecasting. PLoSONE, 12(3), e0174202.
    • Daníelsson, A. (2008). Accuracy in forecasting macroeconomic variables in Iceland (Working papers No. 39). Central Bank of Iceland.
    • Easterly, W. (1989). A consistency framework for macroeconomic analysis (WPS 234). The World Bank.
    • Ewing, R., Gruen, D., & Hawkins, J. (2005). Forecasting the macroeconomy. Economic Roundup. Autumn. The Treasury, 11-25. Canberra.
    • Handbook of national accounting (2002). Use of Macro Accounts in Policy Analysis (Series F. No 81). United Nations. New York.
    • Hawkins, J. (2005). Economic forecasting: History and procedures. Economic Roundup. The Treasury, 1-8. Canberra.
    • Hong, P., Tan, Z. (2014). A comparative study of the forecasting performance of three international organizations (DESA Working Paper No. 133).
    • Hyndman, R. (2015). Business Forecasting: Practical Problems and Solutions (pp. 177-184). John Wiley & Sons.
    • Kim, S., & Kim, H. (2016). A new metric of absolute percentage error for intermittent demand forecasts. International Journal of Forecasting, 32, 669-679.
    • Kiptoo, C. (2011). The case for enhancing the institutional framework for macroeconomic policy coordination in MEFMI countries.
    • Krkoska, L., & Teksoz, U. (2005). Accuracy of growth forecasts for transition countries: Assessing ten years of EBRD forecasting (Working paper No. 94).
    • Kuzmin, E. A. (2016). Theoretical model to estimate system uncertainty in economics. Information, 19(7A), July, 2577-2588.
    • Leal, T., Pérez, J. J., Tujula, M., & Vidal, J.-P. (2007). Fiscal forecasting lessons from the literature and challenges (Working Paper Series. No. 843). European Central Bank.
    • Mazhar, U., & M’Baye, C. K. (2014). Does forecasts transparency affect macroeconomic volatility in developing countries? Evidence from quasi-natural experiments (Working paper GATE 2014-10).
    • Mehdiyev, N., Enke, D., Fettke, P., & Loos, P. (2016). Evaluating Forecasting Methods by Considering Different Accuracy Measures. Procedia Computer Science, 95, 264-271.
    • Mellet, A. (2014). Analysis of macroeconomic forecasting accuracy of South African National Treasury. Mediterranean Journal of Social Sciences, 5(21), September, 265-280.
    • Moreno, J., Pol, A., Abad, A., & Blasco, B. (2013). Using the R-MAPE index as a resistant measure of forecast accuracy. Psicothema, 4, 500-506.
    • National Audit Office of Finland (NAOF). (2016). Reliability of macroeconomic Forecasts. Fiscal policy audit report. Helsinki.
    • Nevskaya, N. A. (2015). Macroeconomic Planning and Forecasting. Moscow: Yurait.
    • Simionescu, M. (2015). The accuracy of general government balance forecasts in Romania. CES Working Papers, VII(1), 167-178.
    • Stănică, C. (2013). Using a macroeconomic model to check forecasts consistency. Romanian Journal of Economic Forecasting, 1, 119-135.
    • The Independent Authority for Fiscal Responsibility (AIReF) (2017). Report on the Macroeconomic Forecasts in the Draft General Government Budget for 2017. Madrid.
Download Preview
Close
Problems and Perspectives in Management
Problems and Perspectives in Management