Tuesday, 25 June 2019

The Abuse of Governance Indicators



Is ‘Good Governance’ a Good Development Strategy?[1], titled a paper published by the French Trésor (finance ministry) and Agence francaise de développement  a decade ago. The answer was that there is a correlation between “good governance” and the level of development (per capita GDP), but there is no correlation with the speed of development (medium-to-long-term growth). Why? Popular governance indicators promoted by the CwA (the G20 Compact with Africa) do not touch on the driving forces behind institutional, economic, political and social change. Instead, the authors argue, based on the 2006 Institutional Profiles database, that the priority for low-income countries is to build capacities for strategic vision and co-ordination among elites. Simultaneously, Besley & Kudamatsu (2007), have shown that autocracies produce either better sustained growth outcomes (e.g., Singapore, which serves as a reference for Chinas policy elites) or worse (e.g., Zimbabwe) than democracies. This depends on the accountability of their performance to a “selectorate” able to remove poor performers from office. However, the ability of autocracies to maintain a merit-driven selectorate is questionable, given the predominance of patronage factors[2].

Governance measures associated with and derived from modern social market economies would have offered insufficient predictive help in foretelling the winners and losers in economic development of recent decades. Outstanding performances in terms of years gained in life expectancy at birth, points progressed in the UN Human Development index, or deletion of extreme mass poverty have been recorded in authoritarian development states such as China, Rwanda or Singapore. These indicators of sustained transformation do not play an important role in the Compact with Africa. Still, the German government has been quite specific on its use of governance indicators: “To measure the level of good governance in the partner countries, the German government relies in particular on internationally recognized indices such as the Bertelsmann Transformation Index, Transparency International's Corruption Perception Index and the World Bank's Doing Business Index.”[3]Note, in particular, that the World Bank´s traditional World Governance Indicators (WGI) were not mentioned.

All these indicators of governance and institutional strength are composite (or “aggregate”) perceptions-based indicators. Such indicators aggregate often large amounts of information from diverse sources and reduce it to a single number – a single governance score – per country, per year, to facilitate comparisons. The aggregated information consists of people’s perceptions of the quality of governance, or some aspect of governance (e.g., the rule of law, control of corruption), in different countries. Most of the people whose perceptions are used are diplomats or business managers, and some live outside the countries they are rating.

Table 1: CwA Countries Fact Sheet

Notes: a) GNI/capita, Atlas method (current US$); EoDB = Ease of Doing Business; CPIA = Country Policy and Institutional Assessment; Risk of Debt Distress = recent IMF/World Bank assessments.

·       The Bertelsmann Stiftung’s Transformation Index (BTI) measures annually quality of democracy, market economy, and political management using data from 129 developing and transitional countries (2018), with scores running from 1 (low) to 10 (Western model reached). The 2018 average governance score was 4.80; this is considerably lower than the average 2018 BTI score of 5.26 for the unweighed mean of the twelve Compact countries (see Table 1). According to the website, the BTI “aggregates the results of of transformation processes and political management into two indices: Status Index and Management Index. The Status Index, with its two analytic dimensions of political and economic transformation, identifies where each of the countries stand on their path toward democracy under the rule of law and a social market economy. Focusing on the quality of governance, the Management Index assesses the acumen with which decision-makers steer political processes”[4].
Local difficulties of policy implementation are hereby taken into account. A look at the status index reveals the Western model of democracy and of a fully-fledged market economy as the benchmark for the BTI. The BTI, among many other issues, measures how of national elites to respond to global challenges with economic policies that ensure stability and social inclusion. Social inclusion by two indicators, the level of socioeconomic development (reducing poverty and inequality), and the extensiveness of social safety nets (government policies to compensate for social risks and alleviate handicaps)[5].
However, the BTI scores reflect an extremely broad and ambitious agenda under the general heading of governance. The laundry list approach assumes that all developing and emerging countries suffer from the same problems, and that all of these problems are equally important. As emphasized by many growth experts, an unweighted check-off of selected governance elements leads to an undifferentiated reform program that fails to target an economy´s most severe growth bottlenecks[6].

·       The Transparency International Corruption Perception Index (CPI), according to its website, “scores countries on how corrupt their public sectors are seen to be”. Determined by annual expert assessments and opinion surveys, the CPI defines corruption as "the misuse of public power for private benefit"[7]. The corruption index currently ranks 180 countries by their perceived levels of public sector corruption according to currently 13 sources, uses a scale of 0 to 100, where 0 is highly corrupt and 100 is very clean. More than two-thirds of countries score below 50 on this year’s CPI, with an average score of just 43.  With an average 2018 CPI score of 39.25, the twelve African CwA partners were perceived a slightly more corrupt than the world average (Table x). CPI source data capture various aspects of corruption, such as bribery, diversion of public funds, nepotistic appointments in civil service or state capture by narrow vested interests. Importantly, it does not capture citizen perceptions or experience of corruptio tax fraud, illicit financial flows, enablers of corruption (lawyers, accountants, financial advisors etc.), money-laundering and private sector corruption.[8] 13 data sources were used to construct the Corruption Perceptions Index (CPI) 2018, such as the AfDB (that co-manages the CwA), Bertelsmann (with two indices), Economist Intelligence Unit, Freedom House, the World Bank Country Policy and Institutional Assessment (CPIA) or the World Economic Forum Executive Opinion Survey[9]. As, importantly, trade unions (via the ILO) nor Asian or Latin American sources are absent, the CPI reflects largely business and Western opinions while it discriminates against voice by labour and the ´South´.

A key feature of the CPI is the inclusion of an estimated “confidence interval” together with the point score for each country covered by the indicator. Thus, differences between countries’ point scores whose confidence intervals overlap should be considered statistically insignificant[10]. The different sources of information used to calculate the point scores do in fact tend to correlate with each other. The imprecision of scores is at odds with the CwA´s use of countries’ governance scores as if they were accurate to a degree they are not.

·       The World Bank´s ´Ease of Doing Business´ (EoDB) index[11] measures the degree to which the regulatory environment is conducive to the starting and operation of a local firm. The Doing Business Indicators were published for the first time in 2004 and are provided from 2003 onwards on a yearly basis by the International Finance Corporation, the private-finance arm of the World Bank Group (IFC). Doing Business 2019 measures for 190 economies the processes for business incorporation, getting a building permit, obtaining an electricity connection, transferring property, getting access to credit, protecting minority investors, paying taxes, engaging in international trade, enforcing contracts and resolving insolvency. The index runs from 0 to 100 (perfect). The ease of doing business score benchmarks economies with respect to regulatory best practice, showing the absolute distance to the best regulatory performance on each Doing Business indicator.  When compared across years, the ease of doing business score shows how much the regulatory environment for local entrepreneurs in an economy has changed over time in absolute terms. Doing Business collects and publishes data on labour market regulation with a focus on the flexibility of employment regulation as well as several aspects of job quality. However, labour market issues (such as the ease to fire workers) have meanwhile been discontinued from EoDB rankings.

The EoDB index has been subject to heavy criticism since a while (Arndt and Oman, 2006)[12]. Early 2018, the World Bank’s chief economist at the time, Paul Romer, told the Wall Street Journal he had lost faith in the integrity of the Doing Business index, suggesting it was being politically manipulated—particularly to embarrass Chile’s socialist president Michelle Bachelet. He then announced his resignation. Chile was not a single ´accident´. EoDB methodology changes pushed dozens of other countries up and down as well, as shown by CGD author Justin Sandefur and colleague[13]. India’s rise in the Doing Business rankings celebrated by India’s Prime Minister Narendra Modi (“the largest democracy on earth is also the fastest growing major economy”) turned out to be mostly an artefact of methodological changes (as did India´s faked numbers of growth). The CGD authors concluded: “changes over time in the Doing Business rankings are not particularly meaningful. They largely reflect changes in methodology and sample—which the World Bank makes every year, without correcting earlier numbers—not changes in reality on the ground.” Sandfur recommends that the World Bank “Should Ditch the "Doing Business" Rankings”[14].

Beside the governance indicators presented above (Bertelsmann BTI, Transparency International CPI, and Doing Business of the IFC), the quality of institutions matters crucially in the design of the CwA. As mentioned before, Schuknecht et al (2018) explicitely refer to the influential book “Why Nations Fail” by Acemoglu & Robinson (2012)[15]. The core thesis of the book is: The design of political institutions has a decisive influence on the design of economic institutions. These in turn influence the level of technological progress, which in turn is a decisive factor for economic growth. Many economists find that monocausal (and anecdotal) explanation unsatisfactory. The most prominent rejection has come by Jeffrey Sachs[16] who points to the complex nature of development: “most of the economic leaps that laggard countries have made can be credited not to domestic technological innovations but to flows of technology from abroad, which in turn have been financed by export receipts from natural resources and low-wage industries. What‟s more, authoritarian political institutions, such as China‟s, can sometimes speed, rather than impede, technological inflows. China has proved itself highly effective at building large and complex infrastructure that complements industrial capital, and this infrastructure has attracted foreign privatesector capital and technology”. Many other prominent social scientists have criticised Why Nations Fail, often for its monocausality, confusion of causes and effects, or lack of statistics-based evidence[17].

Table 2: Institutional Strength & Debt Sustainability

Source: IMF (2018), The Debt Sustainability Framework for Low-Income Countries.
Note: Given that concessionality is an important element in financing LICs, the debt concept used in the template focuses on the present value (PV) of debt.


A crucial indicator to measure the quality of a country´s institutions is the World Bank's Country Policy and Institutional Assessment (CPIA). The index measures the institutional strength of a country, with 1=low, and 6=high. It scores countries against a set of 16 criteria grouped in four clusters: economic management, structural policies, policies for social inclusion and equity, and public sector management and institutions. Until mid 2018, IMF and World Bank have been relying exclusively on the CPIA to classify low-income countries’ debt-carrying capacity in their joint Debt Sustainability Framework for low-income countries (DSF). While other economic variables have been added since then, the CPIA is still relied on to provide a composite indicator of institutional strength measured by the World Bank to assess a country’s debt-carrying capacity. The CPIA assessment of institutional strength translates into into one of three debt-carrying capacity categories (strong, medium, and weak), as indicated in Table x. Corresponding to these categories, the framework establishes three indicative thresholds and a benchmark for each of five debt burden indicators (assessed in terms of GDP, exports, and revenues) On the basis of these thresholds and benchmark, the debt sustainability analyses include an assessment of the risk of external and overall debt distress based on four categories: low risk (when there are no breaches of thresholds); moderate risk (when thresholds are breached in risk scenarios); high risk (when thresholds are breached in the baseline scenario); and in debt distress (when a distress event, like arrears or a restructuring, has occurred or is considered imminent). The IMF assessment of debt sustainability provides an important signal to private portfolio investors and creditors, domestic and foreign. Consequently, CPIA scores importantly determine the investability of CwA countries.
                             



[1] Jacques Ould Aoudia & Nicolas Meisel (2007), “Is ‘Good Governance’ a Good Development Strategy?”, Document de travail du Trésor et de l’AFD, Paris, November.
[2] Timothy Besley & Masayuki Kudamatsu (2007), “What Can We Learn from Successful Autocracies?”, Vox, July.
[3] Deutscher Bundestag (2018), Drucksache 19/6066, 28. 11. 2018, op.cit.
[5] Hauke Hartmann & Daniel Schraad-Tischler (2012), “Social Exclusion and Political Change”, Americas Quarterly, Vol.13, Issue 2, Spring. For criticism of legitimacy and paradigm of the BTI, see Jörn Hagenloch (2005), “Die neue Weltordnung aus Gütersloh”, Telepolis, 23. November.
[6] On the political agenda(s) of Bertelsmann Stiftung and its collusion with the media company Bertelsmann SE & Co., see Matthew Karnitschig (2019), “How Bertelsmann mixes business, philanthropy and Continental politics”, Politico.
[8] Transparency International, Corruption Perceptions Index 2018: Frequently Asked Questions.
[9] Transparency International, Corruption Perceptions Index 2018: Full Source Description. 
[10] Charles P. Oman and Christiane Arndt (2010), Measuring Governance, OECD Development Centre Policy Brief No. 39, Paris.
[12] Christiane Arndt and Charles P. Oman (2006), Uses and Abuses of Governance Indicators, OECD Development Centre Policy Studies, Paris.
[13] Justin Sandefur & Divyanshi Wadhwa (2018), „A Change in World Bank Methodology (Not Reform) Explains India’s Rise in Doing Business Rankings”, Center for Global Development, Washington DC, February.
[14] Justin Sandefur & Divyanshi Wadhwa (2018), „Chart of the Week #3: Why the World Bank Should Ditch the ´Doing Business´ Rankings—in One Embarrassing Chart”, Center for Global Development, Washington DC, January.
[15] Daron Acemoglu & James Robinson (2012), Why Nations Fail: The Origins of Power, Prosperity, and Poverty, New York.
[16] Jeffrey D. Sachs (2012), “Government, Geography, and Growth: The True Drivers of Economic Development”, Foreign Affairs, September.

Saturday, 4 May 2019

G20 ´Compact with Africa´: Audacity of Hope


The Compact with Africa (CwA)[1] initiative is the main pillar of the G20 Partnership with Africa. It initially started in March 2017 as an initiative of the G20 Finance Track to promote private investment in the African continent, with a focus on levering private infrastructure finance via blended finance to facilitate subsequent foreign direct investment (FDI) flows. Ludger Schuknecht and coauthors, then affiliated at top positions with the German ministries of finance and cooperation, have succinctly outlined paradigm, motivation, work mechanics and objectives of the CwA[2]. The concept for the CwA is simple: Good governance is conceived as a prerequisite for enhanced private foreign investment for infrastructure, which in turn helps attract foreign direct investment inflows. To these ends, the international community contributes to the development of good economic institutions by investing in a "compact" with reform-minded poor countries.

Notwithstanding the existing Monitoring Reports posted on the CwA website, hard empirical evidence on output indicators for governance and instituitional quality, portfolio flows trigged for infrastructure as well as green-field FDI (and jobs) created in the Compact countries is still mostly absent, to my knowledge. Official CwA documents have rather focused on input indicators (such as meetings or investment plans) and anecdotal evidence to assess the progress of the Initiative. This blogpost aims at a first, preliminary (and, I admit, premature) presentation of output indicators for the Compact partner countries. (So informed comments are very welcome.). It is not intended (nor possible at this early stage) to present hard empirical evidence to establish causality. If anything, the data presented might be suggestive of a structural break of governance scores and private foreign flows in the compact countries before and after the CwA was launched in March 2017.

The CwA evokes Barrack Obama´s 2006 book ´The Audicity of Hope´, because the Compact postulates that its mechanics can spur private foreign investment and sustainable transition even in low-income countries. Kappel & Reisen (2017) have argued earlier that such premise is ´unsuitable´ for low-income countries[3]. The brilliant Graph 1 (from OECD, 2019)[4] seems to support that scepticism. The OECD graph presents the evolution of the external financing mix for developing countries during the transition process. Its focus is on the percentage contribution of external resources (left y axis), while including the relative importance of domestic resources (right y axis), and shows the evolution of the mix as income per capita increases (x axis).

Graph 1: Financing Mix during the Transition from LIC to HIC Status

Source: OECD (2019), Transition Finance: Introducing a New Concept, OECD Development Co-Operation Working Paper 54.

As the graph shows, the percentage share of private flows to total external flows for LICs and LMICs has on average been well below 10% during the 2012-2016 preceding the Compact. Private external flows start to dominate the external financing mix (with more than 50%) only once countries graduated from upper-middle income (UMICs) to high-income (HICs), with a annual GNI per capita of $12,056 or more[5]

To put the ´Audacity of Hope´ of the CwA into perspective, note that all twelve Compact countries produce a yearly income per head at such low levels that they are either classified as low-income countries (LICs) or lower-middle-income countries (LMICs), as shown in Table 1.

Although the mean annual per capita income varies widely across the group of Compact countries – from $590 (Burkina Faso) to $3,490 (Tunisia) – they all remain widely below income levels where an important contribution of private external flows can be reasonably expected.

Moreover, some Compact countries (Ethiopia, Ghana) have been assessed recently under ´high´ risk of debt distress in the IMF/WB Debt Sustainability Framework. Debt vulnerability should further mitigate the role of external private flows to fund a country, if it comes in the form of debt-creating flows, including through blended finance.

Table 1: African Compact Countries Fact Sheet

Compact Countries
GNI/cap a)
Income Status
EoDB
15-16
EoDB
17-18
CPIA
15-16
CPIA 17
Risk of Debt Distress
2017
2018
Score
Score
Score
Score
2018
BENIN
800
LIC
49
51
3.45
3.50
moderate
BURKINA FASO
590
LIC
51
51
3.60
3.60
moderate
CÔTE D´IVOIRE
1580
LMIC
51
56
3.35
3.40
moderate
EGYPT
3,010
LMIC
55
57
n.a.
n.a.
moderate
ETHIOPIA
740
LIC
46
49
3.55
3.40
high
GHANA
1,880
LMIC
57
58
3.55
3.60
high
GUINEA
790
LIC
48
51
3.15
3.20
moderate
MOROCCO
2,860
LMIC
67
70
n.a.
n.a.
low
RWANDA
720
LIC
69
76
4.00
4.00
low
SENEGAL
1,240
LIC
49
54
3.80
3.80
low
TOGO
610
LIC
48
52
3.00
3.10
heightend
TUNISIA
3,490
LMIC
64
65
n.a.
n.a.
low
54.5
57.5
3.49
3.51
Notes: a) GNI/capita, Atlas method (current US$); EoDB = Ease of Doing Business; CPIA = Country Policy and Institutional Assessment; Risk of Debt Distress = recent IMF/World Bank assessments.


Next to annual data for gross national income per capita (GNI/cap) and the Income Status classification by the World Bank, Table 1 presents governance scores for the two years preceding the CwA launch (2015 and 2016) and the two subsequent years (2017 and 2018, if available):
-          The World Bank´s controversial ´Ease of Doing Business´ (EoDB) index measures the degree to which the regulatory environment is conducive to the starting and operation of a local firm. The index runs from 0 to 100 (perfect). The ease of doing business score benchmarks economies with respect to regulatory best practice, showing the absolute distance to the best regulatory performance on each Doing Business indicator.  When compared across years, the ease of doing business score shows how much the regulatory environment for local entrepreneurs in an economy has caught up relative to best practice.
-          The World Bank's Country Policy and Institutional Assessment (CPIA) index measures the institutional strength of a country, with 1=low, and 6=high. It scores countries against a set of 16 criteria grouped in four clusters: economic management, structural policies, policies for social inclusion and equity, and public sector management and institutions. Until mid 2018, IMF and World Bank have been relying exclusively on the CPIA to classify countries’ debt-carrying capacity in their joint Debt Sustainability Framework for low-income countries (DSF). While other economic variables have been added since then, the CPIA still provides a useful characterization of debt vulnerabilities (including those from domestic debt and market financing).
Encourageingly, the ´Ease of Doing Business´ (EoDB) indicators significantly improved on average (red numbers) in the Compact countries from the pre-CwA period 2015-16 to thereafter. However, the CPIA scores did not[6]. While we have to wait for newer CPIA scores, I cannot reject the null hypothesis that the first CwA objective has been reached – to provide incentives for compact countries to improve business conditions for private investment.

Table 2: Private Flows to African Compact Countries
- current US$ million-
Compact Countries
Risk Debt Distress
PPI 15/16
PPI 17
FDI 15/16
FDI 17/18

2018




Benin
moderate
0
0
141
184
Burkina Faso
moderate
0
517
311
486
Côte d´Iv
moderate
0
471
536
675
Egypt
moderate
106
2898
7516
7392
Ethiopia
high
0
0
3308
4017
Ghana
high
3,205
550
3339
3255
Guinea
moderate
0
121
836
577
Morocco
low
2,014
460
2786
2680
Rwanda
low
0
422
245
293
Senegal
low
396
114
441
532
Togo
heightened
0
0
106
146
Tunisia
low
0
0
797
810


5,721
5,553
20362
21047

Table 2 presents more sobering findings as to the private flows, which the Compact may have triggered, by comparing the mean of the two years preceding the CWA launch with the mean of the two years thereafter. The table provides
·       preliminary data from the Private Participation in Infrastructure (PPI) Project database of the World Bank, a comprehensive indicator of credit and portfolio flows that fund 6,400 infrastructure project in 139 low- and middle-income countries; and
·       Foreign direct investment (FDI, net inflows), assembled from the International Monetary Fund, Balance of Payments database, supplemented by data from the United Nations Conference on Trade and Development and official national sources.



The sum of PPI actually fell slightly after the CwA launch in the Compact countries. Exceptions are Rwanda and in particular Egypt where PPI soared in terms of size of annual flows and number of projects. A third of the dozen Compact countries – Benin, Ethiopia, Togo and Tunisia – did not receive any private foreign infrastructure funding after the CwA launch according to the PPI database.
The sum of mean annual FDI flows, by contrast, increased by US$ 700 million after the CwA launch, to a total of US$ 21 billion during the years 2017-18. Again, Egypt received the bulk of that sum (as it had done before the CwA launch), roughly US$ 7.5 billion. Compared to the two-year period preceding the CwA launch, ten out of twelve Compact countries recorded higher annual FDI flows.
Clearly, the CwA results as measured by output indicators are mixed two years after the launch of the initiative. But they are not outright negative. More perseverance by private firms and investors, risk-sharing development finance institutions and authorities both local and foreign is needed. Importantly, however, the audacity of hope that carries the Compact seems to be justified so far.



[2] Ludger Schuknecht, Johannes Wolff, Andreas Gies & Stefan Oswald (2018), “Der G20 Compact with Africa–ein neuer Ansatz der wirtschaftlichen Zusammenarbeit mit afrikanischen Ländern“, ifo Schnelldienst 4 / 2018.
[3] Robert Kappel and Helmut Reisen (2017), The G20 “Compact with Africa” – Unsuitable for African low-income Countries, FES Discussion Papers, Friedrich-Ebert-Stiftung, Berlin.
[4] OECD (2019), Transition Finance: Introducing a New Concept, OECD Development Co-Operation Working Paper 54, Paris. The excellent paper has been authored by Cecilia Piemonte (work stream lead), Olivier Cattaneo, Rachel Morris, Arnaud Pincet and Konstantin Poensgen.
[6] A two-tailed t-test of the two EoDB columns and for the two CPIA columns produced a t-value of 0,249787947, a value too low to reject the null hypothesis that the EoDB and CPIA means were equal before and after.