## Supervised Learning of the Global Risk Network Activation from Media Event Reports

Xiang Niu · Gyorgy Korniss · Boleslaw K. Szymanski

Abstract The World Economic Forum (WEF) publishes annual reports of global risks which have the high impact on the world's economy. Currently, many researchers analyze the modeling and evolution of risks. However, few studies focus on validation of the global risk networks published by the WEF. In this paper, we first create a risk knowledge graph from the annotated risk events crawled from the Wikipedia. Then, we compare the relational dependencies of risks in the WEFand Wikipedia networks, and find that they share over 50% of their edges. Moreover, the edges unique to each network signify the different perspectives of the experts and the public on global risks. To reduce the cost of manual annotation of events triggering risk activation, we build an auto-detection tool which filters out over 80% media reported events unrelated to the global risks. In the process of filtering, our tool also continuously learns keywords relevant to global risks from the event sentences. Using locations of events extracted from the risk knowledge graph, we find characteristics of geographical distributions of the categories of global risks.

Xiang Niu

Department of Computer Science &amp; Network Science and Technology Center, Rensselaer Polytechnic Institute (RPI), Troy, NY, USA

E-mail: niux2@rpi.edu

Gyorgy Korniss

Department of Physics &amp; Network Science and Technology Center, Rensselaer Polytechnic Institute (RPI), Troy, NY, USA

E-mail: korniss@rpi.edu

Boleslaw K. Szymanski Department of Computer Science &amp; Network Science and Technology Center, Rensselaer Polytechnic Institute (RPI), Troy, NY, USA E-mail: szymab@rpi.edu

Keywords Global risk network · Knowledge graph · Auto-detection · Supervised learning

## 1 Introduction

The World Economic Forum publishes annually the list of global risks and their properties. . The global risks are clustered into five categories: Economic, Environmental, Geopolitical, Societal and Technological [1]. These risks affect many aspects of lives of countless people. Economic risks may inflict tremendous damage on individuals, financial institutions, and governments. For example, in 2008, the asset bubble in several countries caused most of the major economies to undergo a recession lasting several years [2]. Environmental risks affect both individuals and infrastructure but their impact is global when thousands of people die or are displaced by hurricanes or earthquakes [3]. Geopolitical risks are mainly caused by a failure of national or global governance but may result in millions of people suffering from war [4], hunger [5], and poverty [6]. Technological risks are real and often unpredictable consequences of advanced technologies such as cyberattacks [7] and data leaks [8] threatening well-being of individual and corporations. In short, all risks have critical ability to disrupt civilization at diverse levels, ranging from individuals to nations, so there is an is urgent need to develop tools for their discovery, analysis and prediction.

The big challenge to progress in this direction is to identify activation of global risks from massive event records in Web media. Therefore, risk-event labeling is a fundamental and necessary preparatory step before any in-depth study of risks, such as risk modeling [9] and control [10], can be attempted. A high-quality dataset combined with the validated models are a foundation for global risks reliable discovery, analysis and predic-

tion. The first systematic approach for such data collection effort was done and described in [11], in which the researchers manually collected monthly data points for each risk using online event resources such as articles, news, and Wikipedia to annotate events relevant to any global risk activation. The covered period ranged from beginning of year 2000 to the end of year 2016. Considering the inaccuracy and incompleteness of manually labeled risk event records, researchers further improve these aspects of collected data by providing a detailed reason for selecting each risk event [12, 13]. However currently, manual annotation is the only way to label risk events because of the difficulty to automate this operation caused by the unstructured format of event description. Here, we first propose a human-machine interaction model to augment the manual annotation process by precisely filtering out a large number of unrelated event. Then, we enhance this process by continuously expanding keyword sets for events using the supervised online-learning.

The auto-detection tool helps analysts to detect every single risk from event descriptions in Web media. However, individual risk analysis is not sufficient because rarely a risk activation happens in isolation. According to the annual report from the World Economic Forum, the connectivity among risks is common and complicated. The global risks are clustered into five categories but their links includes both intra-category and inter-categories edges, both types of which are common. Most of the societal risks can activate under influence of economic (profound political and social instability), environmental (rapid and massive spread of infectious diseases) or geopolitical (large-scale involuntary migration) risks. The yearly WEF Global Risk Report is based on the experts' answers to the annual questionnaires that ask about each risk probability of activation, such activation costs to global economy and interconnectivity between risks. This dependence on expert opinions raises one important question: 'how well do the experts estimate risk probability of activation, impact, and interconnectivity?' followed by another: 'are their networks reliable, integrated, and representative?' To partially answer these questions, here, we create another risk network based only on the risk events discovered in Web media data. Then, we compare the resulting network with the WEF global risk network for the same risk nodes to assess both networks correctness and authoritativeness. We expect that the network from event risk data will be biased towards risks with high level of public awareness, which tend to be directly related to human lives, such as ' Asset bubble ' and ' Extreme weather event '.

Although the global risks attempt to represent events with impact on global economy and systematic impact on the entire world, most of the time, the risk events occur locally and have regional effects and influence. Thanks to the specific characteristic of the risk-events dataset, we extract local information from each event record and build connections between the locations and related risks. Having collected data for the period from year 2000 to 2014, we illustrate the different regional patterns of five risk categories on the world political maps.

## 2 Risk detection

In [11], authors investigate multiple event resources including articles, news, Wikipedia. Here, we only focus on the Wikipedia Current Events Portal (WCEP) [14], which comprehensively includes daily summaries of news events edited by crowdsourcing. Because of its popularity and completeness, the WCEP has been fully analyzed by comparing it with content written by professional journalists in WikiTimes project [15]. The conclusion of this project is that the WCEP is a representative source of public news thanks to its stable contribution volumes and crowdsourcing. The WikiTimes [15] also provides specific crawling methods and extracted dataset with over 50k events from the WCEP from the year 2000 to 2014, which are sufficient enough for the risk-event labeling and further studies. In the dataset, each event contains information detailed in Table 1. Fig. 1 shows sample subnetwork of events. The event 4359, with description ' Tropical Storm Gaston douses Richmond, Virginia, with up to 14 inches of rain, causing widespread flooding ' and entities ' Tropical Storm Gaston ', ' Virginia ' and ' Mark Warner ', are parts of story ' 2004 Atlantic hurricane season ' occurring on Aug. 30, 2004, reported by ABC-NEWS. The event 4571 is described as ' At least nine deaths in Florida, two deaths in the Bahamas, and one death in Georgia are blamed on the storm. Damage estimates range widely from US $ 2 to US $ 15 billion '. The event 4622 reports ' The Cuban government evacuates between 800,000 and 1.3 million people from coastal cities and developed areas '. The last two events are parts of the same story about ' 2004 Atlantic hurricane season '.

Manual annotation requires a person to go first through the event description word by word and select the risk related keywords, then label the event with risk tags according to the keywords. For example, for the event 4359, two keywords ' storm ' and ' flooding ' may be selected and then the event will be labeled with tags ' storm ' and ' flood ' accordingly. Both tags belong to the same risk ' 10. Extreme weather events ', as shown

Table 1 Structured event information extracted from the WCEP [15].

| Concept    | Description                                     |
|------------|-------------------------------------------------|
| Event      | sentences of a news summary                     |
| Story      | a story in Wikipedia of which the event is part |
| Category   | a category to which the event belongs           |
| Date       | the event date of occurrence                    |
| Entities   | a list of entities in the event sentences       |
| References | external sources for the same event             |

Fig. 1 An example of risk knowledge graph consisting of three events. Event 4359: ' Tropical Storm Gaston douses Richmond, Virginia, with up to 14 inches of rain, causing widespread flooding. (8/30/04) '. Event 4571: ' At least nine deaths in Florida, two deaths in the Bahamas, and one death in Georgia are blamed on the storm. Damage estimates range widely from US $ 2 to US $ 15 billion. (9/7/04) '. Event 4622: ' The Cuban government evacuates between 800,000 and 1.3 million people from coastal cities and developed areas. (9/13/04) '.

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00164v2-figure-fe84387a-17d3-4a81-b27c-daadf19faf90.jpg)

Table 5 in Appendix. The event 4571 contains two more tags ' death ' and ' economic loss ' in addition to ' storm '. Thus, this event shows the activity of one more risk ' 11. Failure of climate-change mitigation and adaptation ', see Table 5 in Appendix. The event 4622 contains only one tag ' evacuation ', which belongs to risk ' 23. Largescale involuntary migration ', as shown in Table 7 in Appendix. Thus, the three events represent the activities of three risks in two risk categories: environmental risks, as seen in Table 5 in Appendix, and societal risks according to Table 7 in Appendix.

With the development of modern information society, there is a large number of news events described all over the internet. Specifically, around three thousand new events are generated in the WCEP every year amounting to about 250 per each month and over fifty thousand events in the past 15 years. Given 29 risk labels and around 20 words per event description, an expert would have to go through 3000 × 30 × 20 so nearly two million comparisons to process just one year of events data in the WCEP, which is a heavy workload. Besides, during the labeling, only a few (around two thousand) of the fifty thousand events are relevant to global risks. These observations motivated us to create an auto-detection tool to help analysts by filtering out the irrelevant events, thereby saving time in risk-event labeling. Our risk auto-detection module is depicted in Fig. 2. The detailed processing proceeds according to the following steps:

- - Step 1 . Initially, an analyst prepares a few keywords and tags for each risk according to the description of 29 risks in Appendix based on [1].
- - Step 2 . If the given list of new pairs with keyword k and tag t 〈 k, t 〉 is empty, processing terminates, otherwise, these pairs are merged into keyword dictionary.
- - Step 3 . For each event e and a list of keywords K , each paired with some tag t , if a keyword k ∈ K appears in the event sentence manually accepted as relevant, the event e is labeled with the tag t as 〈 e, t + 〉 , otherwise, the event e is labeled as 〈 e, t -〉 .
- - Step 4 . We use a bag-of-words representation b = 〈 w , c 1 1 〉 , ..., 〈 w ,c n n 〉 for each event sentence, where w i is the ith word of event sentence in e , c i is the count of appearances of the word w i for n unique words. For each tag t , we have a list of events: 〈 e, t + 〉 is a positive instance with bag-of-words representation b + ∈ B + , while 〈 e, t -〉 is a negative instance with bag-of-words representation b -∈ B -in the event sentence.
- - Step 5 . With random forest classifier given training dataset B + and B -, we get entropy ranking of featured keywords w , w , ..., w 1 2 m , where m is the total number of unique words in B + and B -. The words with high rank are important for the classification.
- - Step 6 . Based on the entropy ranking list, we select meaningful keywords from top a (default a = 5) new ones and create a list of 〈 k, t 〉 . Then, processing restarts at step 2.

Tables 4-8 in Appendix show the list of selected tags and keywords of 29 risks with current dataset up to year 2014. With new events data, the module can update the list further and improve the filtering accuracy. In step 3, the events without any keyword k ∈ K or rejected by analysts are filtered out as non-relevant events.

## 3 Risk network

The auto-detection module produces a structured event dataset containing rich independent information such

Fig. 2 The activity diagram of risk auto-detection module.

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00164v2-figure-5325c8fe-0851-4ef0-89af-ffa19b7d194c.jpg)

Fig. 3 The entire risk knowledge graph with small yellow nodes representing events, small purple nodes representing the date, and large nodes representing thirty risks from five colored categories: economic, environmental, geopolitical, societal, and technological.

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00164v2-figure-dfe6eb9f-d6a0-4e05-95df-4df2e01eaf14.jpg)

as risk labels, stories, event descriptions, their occurrence locations, and dates. Based on that, with the specific principal (story) and subordinate (event) relationship, we further build event correlations, see Fig. 1. Any two events are considered related when they belong to the same story. The knowledge graph includes the following four types of relationships:

- -At date of: an event e happened at date d . Any event e has a unique d associated with it. But one date d may correspond to multiple events.
- -At location of: an event e happened at location l or at location relevant to l . Any event e may happen (affect) multiple locations, e.g., Fig. 1 event 4571 affected locations at Bahamas, Florida and Georgia. One location l may also correspond to multiple events.
- -Prior to: an event e 1 happened prior to another event e 2 when they are in the same story and the date d 1 of e 1 precedes the date d 2 of e 2 .
- -In risk of: an event e is in risk of t after the event sentence is labeled by the tag t by the auto-labeling module, see Fig. 2.

Fig. 3 depicts the entire knowledge graph that contains all relationships between any two events, and between two pairs for event e , ( e , risk) and ( e , date). Here, we group all tags t 1 , t 2 , ... belonging to the same risk r into one risk node. For example, in Fig. 1, event 4359 is in risk of ' storm ' and ' flood ', which correspond to the same risk ' 10. Extreme weather event '.

glyph[negationslash]

Additionally, we extracted the risk network (Wiki in Fig. 4) from the entire knowledge graph (Fig. 3). For each pair of events ( e 1 , e 2 ), when e 1 is prior to e 2 , e 1 is in risks of R 1 and e 2 in risks of R 2 , we create an edge between each pair of ( r i , r j ), r , r i j ∈ R 1 ⋃ R , i 2 = j . For example in Fig. 1, event 4359 is in risks of ' 10. Extreme weather event ' r 10 , event 4571 is in risks of ' 10. Extreme weather event ' r 10 and ' 11. Failure of climate-change mitigation and adaptation ' r 11 , event 4622 is in risks of ' 23. Large-scale involuntary migration ' r 23 . Thus, we have three connections r 10 -r 11 , r 10 -r 23 and r 11 -r 23 . To make a comparison of so created network with the undirected and unweighted risk

Fig. 4 A comparison between two risk networks, one created by the WEF and the other built by us from Wiki events. The first subfigure is the common part extracted from the two networks, the second subfigure contains edges unique to the WEF network and the third one includes relational dependencies unique to the Wiki network.

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00164v2-figure-a44ca84b-d6e3-433b-8c35-1294d9960423.jpg)

network created by the World Economic Forum (WEF) in report [1], we transform the Wiki network to be also undirected and unweighted, as seen in Fig. 4, where the size of each risk node represents its degree. In general, the two networks are similar in nodes sizes and connections. There are 170 edges in WEF network and 224 edges in Wiki networks, with the number of common edges as high as 121, see Table 2. Specifically, the risk ' 23. Profound social instability ' has the largest number (18) of common related risks between the two networks.

We also highlight the different risk dependencies in WEF and in Wiki networks in Fig. 4. For example, in Wiki network, risk ' 1. Asset bubbles in a major economy ' influences and is influenced also by risks ' 4. Failure/shortfall of critical infrastructure ', ' 22. Large-scale involuntary migration ', and etc. The degree differences between the two risk networks arise from the differ- ent views of the risks by experts and the public. The risks with a higher degree in Wiki network tend to be a focus of public concerns, such as ' 1. Asset bubbles in a major economy ', ' 10. Extreme weather events ', ' 17. Large-scale terrorist attacks ', ' 21. Food crises ' and ' 29. Massive incident of data fraud/theft '. Nevertheless, the risks with a higher degree in WEF network tend to be a focus of expert concerns, often novel or merely newly arising, such as ' 2. Deflation in a major economy ', ' 12. Major biodiversity loss and ecosystem collapse ', and ' 26. Adverse consequences of technological advances '. In addition, in Table 2, the common part of the two networks includes most of the intragroup edges. After extracting it from the WEF and the Wiki network, almost no intra-group edges left, especially in Wiki network. Moreover, in Table 3, after extracting the common part, the WEF network becomes

Fig. 5 Economic risks heat-map over political map of the world.

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00164v2-figure-62acf07a-0345-409d-9bff-8468b99289cc.jpg)

fragmented with extremely low average clustering coefficients in each group and in the entire network.

## 4 Risk activities heat maps layered over the political maps of the world

Using the risk knowledge graph, we extract connections between locations and risks. For any event e in risk r ∈ R that occurred at location l ∈ L , where R is one of five risk categories, L is a country to which location l belongs, we record an occurrence of pair ( R,L ). After processing all events, we obtain the number of occurrences of each pair ( R,L ). For each risk category R , we normalize the number of occurrences in all countries L by taking logarithm of a ratio of number of occurrence+1 in the given country to 1+the maximum number of occurrences in any country for category R . We show the results as a heat-maps layered over the political maps of the world shown in Figs. 5-9. Each of these figures displays normalized levels of activities of one of the five risk categories. For example, in economic risks, the economic risk-events related to Russia occur 42 times, related to Japan 16 times, to India 6 times, to Italy 2 times. These scores after the normalization become 1, 0.75, 0.52, 0.29, respectively.

Most of the economic risks happen in the developed countries or countries with high volume of trading resources, industrial products or services, such as Russia (1.00), U.S. (0.95), Malaysia (0.78), Japan (0.75), Mexico (0.72), Cyprus (0.68), Australia (0.61), Greece (0.61). The most impactful story in Russia is ' 2008 Russian financial crisis ', in the U.S. ' Subprime mortgage crisis ', in Malaysia ' Malaysia Airlines Flight 370 ', in Japan ' Automotive industry crisis of 2008-10 ', in

Fig. 6 Environmental risks heat-map over political map of the world.

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00164v2-figure-68724954-00c0-49db-b1ef-8f228f7811da.jpg)

Fig. 7 Geopolitical risks heat-map over political map of the world.

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00164v2-figure-00be44eb-448d-475e-b2ff-9f3e1eeadf26.jpg)

Mexico ' Mexican Drug War ', in Cyprus ' 2012-13 Cypriot financial crisis ', in Australia ' August 2011 stock markets fall ', and in Greece ' Greek government-debt crisis '. Those economic risks are related to a failure of financial mechanisms such as stock (Russia, Australia), mortgage (U.S.), banking (Cyprus, Greece), illicit trade, such as smuggling (Mexico), and decreased demand for manufacturing products, such as cars (Japan).

The environmental risks usually happen in coastal countries, especially those near Atlantic, Pacific, or Indian Oceans, such as U.S. (1.00), Philippines (1.00), China (0.97), Japan (0.91), India (0.91), Mexico (0.90), Haiti (0.87), Pakistan (0.83), Cuba (0.71). ' Atlantic hurricane season ' mainly affects the U.S., Mexico, Haiti, Cuba. ' Pacific typhoon season ' mainly affects the Philippines, China, Japan. ' North Indian Ocean cyclone season ' mainly affects India. Beyond that, some other dis-

| Networks    | Economic   | Economic   | Environmental   | Environmental   | Geopolitical   | Geopolitical   | Societal   | Societal   | Technological   | Technological   | Whole Network   |
|-------------|------------|------------|-----------------|-----------------|----------------|----------------|------------|------------|-----------------|-----------------|-----------------|
|             | Intra      | Inter      | Intra           | Inter           | Intra          | Inter          | Intra      | Inter      | Intra           | Inter           | Number of edges |
| Common part | 21         | 36         | 4               | 22              | 8              | 29             | 12         | 47         | 3               | 12              | 121             |
| WEF only    | 4          | 13         | 6               | 14              | 2              | 11             | 2          | 13         | 3               | 13              | 49              |
| WEF         | 25         | 49         | 10              | 36              | 10             | 40             | 14         | 60         | 6               | 25              | 170             |
| Wiki only   | 6          | 50         | 0               | 28              | 0              | 34             | 1          | 45         | 0               | 35              | 103             |
| Wiki        | 27         | 86         | 4               | 50              | 8              | 63             | 13         | 92         | 3               | 47              | 224             |

Table 2 The number of intra-group and inter-group edges of each risk category and network. WEF represents the network published by the World Economic Forum; Wiki represents the network created by us from Wiki events. Common part represents the edges existing in both networks. WEF only represents the edges unique to the WEF network, while Wiki only includes the edges unique to the Wiki network.

| Networks    | Economic   | Economic   | Environmental   | Environmental   | Geopolitical   | Geopolitical   | Societal   | Societal   | Technological   | Technological   | Whole Network   | Whole Network   |
|-------------|------------|------------|-----------------|-----------------|----------------|----------------|------------|------------|-----------------|-----------------|-----------------|-----------------|
|             | 〈 k 〉    | 〈 c 〉    | 〈 k 〉         | 〈 c 〉         | 〈 k 〉        | 〈 c 〉        | 〈 k 〉    | 〈 c 〉    | 〈 k 〉         | 〈 c 〉         | 〈 k 〉         | 〈 c 〉         |
| Common part | 8.67       | 0.6        | 6.0             | 0.49            | 9.0            | 0.69           | 11.83      | 0.59       | 4.5             | 0.47            | 8.34            | 0.58            |
| WEF only    | 2.33       | 0.0        | 5.2             | 0.06            | 3.0            | 0.31           | 2.83       | 0.17       | 4.75            | 0.01            | 3.38            | 0.1             |
| WEF         | 11.0       | 0.61       | 11.2            | 0.66            | 12.0           | 0.57           | 14.67      | 0.59       | 9.25            | 0.48            | 11.72           | 0.59            |
| Wiki only   | 6.89       | 0.35       | 5.6             | 0.42            | 6.8            | 0.35           | 7.83       | 0.32       | 8.75            | 0.22            | 7.1             | 0.34            |
| Wiki        | 15.56      | 0.74       | 11.6            | 0.81            | 15.8           | 0.81           | 19.67      | 0.72       | 13.25           | 0.85            | 15.45           | 0.78            |

Table 3 The average degree 〈 k 〉 and average clustering coefficient 〈 c 〉 of each risk category and network. WEF represents the network published by the World Economic Forum; Wiki represents the network created by us from Wiki events. Common part includes the edges existing in both networks. WEF only represents the edges unique to the WEF network, while Wiki only includes the edges unique to the Wiki network.

Fig. 8 Societal risks heat-map over political map of the world.

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00164v2-figure-95ea74c5-1f4d-405f-a872-7fe59ccdf100.jpg)

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00164v2-figure-7f807c3a-61e5-4702-89ba-c750f9e7923a.jpg)

asters also happen in the U.S. ' 2011 Mississippi River floods ', in China ' 2008 Sichuan earthquake ', in Japan ' 2011 Thoku earthquake and tsunami ', in India ' 2004 Indian Ocean earthquake and tsunami ', in Mexico ' Deepwater Horizon oil spill ', and in Pakistan ' 2010 Pakistan floods '.

The geopolitical risks are most frequent in countries having unstable regime or involved in international conflicts, such as North Korea (1.00), Thailand (0.80), Iran (0.80), U.S. (0.72), Egypt (0.72), Pakistan (0.62), Syria (0.62), Nigeria (0.62), Iraq (0.38). Risk ' 16. Interstate conflict with regional consequences ' is between the U.S. and Iraq in ' Iraq War '. Risk ' 17. Large-scale

Fig. 9 Technological risks heat-map over political map of the world.

terrorist attacks ' is in Pakistan ' Terrorism in Pakistan ' and Nigeria ' Islamist insurgency in Nigeria '. Risk ' 18. State collapse or crisis ' is in Thailand ' Thai coup d'tat ', Egypt ' Egyptian coup d'tat ', and Syria ' Syrian civil war '. Risk ' 19. Weapons of mass destruction ' is in North Korean ' North Korean nuclear test ' and Iran ' Nuclear program of Iran '.

Societal risks, are often a consequence of geopolitical risks, and usually occur in the same countries as the latter group of risks does, such as Egypt (1.00), Syria (0.98), Yemen (0.80), Libya (0.77), Tunisia (0.77), China (0.76), Russia (0.76), Saudi Arabia (0.73). The most influential story in Egypt is ' Egyptian Revolu-

tion of 2011 ', in Syria ' Syrian civil war ', in Yemen ' Yemeni Revolution ', in Libya ' Libyan civil war ', in Tunisia ' Tunisian Revolution ', in China ' 2009 rmqi riots ', in Russia ' Snow Revolution ', and in Saudi Arabia ' Arab Spring '.

Technological risks frequently happen either in a scientifically developed country such as U.S. (1.00) and U.K. (0.51) or in an unstable nations such as Egypt (0.85), Syria (0.66), Iraq (0.51), Pakistan (0.51), North Korea (0.51). When information technology is highly developed, risk ' 29. Massive incident of data fraud/theft is often active because of a massive amount of official and personal data online, such as ' United States diplomatic cables leak ' in the U.S. and ' News International phone hacking scandal ' in the U.K. Related geopolitical risks may also cause other technological risks. For example, in Egypt, a long-lasting internet blackout and censorship was triggered by ' Egyptian Revolution of 2011 '; in North Korea, risk ' 28. Large-scale cyberattacks ' was caused by ' 2013 Korean crisis '.

## 5 Conclusion

Our paper contributes the first event-driven analysis of global risks using the complete Wikipedia Event Portal dataset over the years 2000 to 2014. To overcome the limitation of risk-event manual annotation used in the current research [11,13], here we introduce a novel risk auto-detection module, which filters out over 80% of data about the non-relevant events and reduces significantly volume of data to be manually labeled. This approach can be used in other machine learning scenarios when the true negative instances account for a large proportion of the dataset during the supervised learning classification. With the help from autodetection tool and sufficient effort devoted to manual labeling, we created the complete and structured dataset from Wikipedia Event Portal, which can be studied indepth in the future. This data set contains two thousand labeled risk events extracted from over 50 thousand events. These labeled risks are structured hierarchically with events linked to stories, locations, dates, categories, and references creating a knowledge network.

From this rich dataset, we build a relational network, which is surprisingly similar to the network created by the WEF experts [1]. Moreover, the differences between the two networks reflect the differences in risk views of the expert and the public. The experts show concerns about yet unseen risks that may arise in the future or have an enormous impact on all humanity, while the public tends to focus on risks that matter more to everyday life. By studying the local effects of risks, we

'

find that the economic risks arise in countries with high volume of trade. The environmental risks are common in coastal areas. The geopolitical risks are concentrated mainly in the Middle East. Most of the societal risks are the consequences of geopolitical risks and thus occur in the same countries as the former. The technological risks arise in scientifically developed countries and in the countries in conflict with other nations.

## Acknowledgment

This work was supported in part by the Army Research Office under grant W911NF-16-1-0524 and by the Army Research Laboratory under Cooperative Agreement Number W911NF-09-2-0053 (NS CTA). The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies either expressed or implied of the Army Research Laboratory or the U.S. Government.

## References

- 1. World Economic Forum Global Risks Report. (2016). URL https://www.weforum.org/reports/ the-global-risks-report-2016 . Accessed: 2018-07-31
- 2. D.H. Erkens, M. Hung, P. Matos, Journal of corporate finance 18 (2), 389 (2012)
- 3. R.A. Pielke Jr, J. Gratz, C.W. Landsea, D. Collins, M.A. Saunders, R. Musulin, Natural Hazards Review 9 (1), 29 (2008)
- 4. J. Lee Ray, Conflict Management and Peace Science 20 (2), 1 (2003)
- 5. P.A. Sanchez, Science 295 (5562), 2019 (2002)
- 6. T. Pogge, Ethics &amp; international affairs 19 (1), 1 (2005)
- 7. T. Rid, B. Buchanan, Journal of Strategic Studies 38 (12), 4 (2015)
- 8. L. Harding, The Guardian 5 (2016)
- 9. X. Lin, A. Moussawi, G. Korniss, J.Z. Bakdash, B.K. Szymanski, Scientific reports 7 (1), 6699 (2017)
- 10. D. Baloi, A.D. Price, International journal of project management 21 (4), 261 (2003)
- 11. B.K. Szymanski, X. Lin, A. Asztalos, S. Sreenivasan, Sci. Rep. 5 (10998) (2015)
- 12. X. Niu, A. Moussawi, N. Derzsy, X. Lin, G. Korniss, B.K. Szymanski, in International Workshop on Complex Networks and their Applications (Springer, 2017), pp. 11241134
- 13. X. Niu, A. Moussawi, G. Korniss, B.K. Szymanski, Applied Network Science 3 (1), 24 (2018)
- 14. Wikipedia event portal (2019). URL https:// en.wikipedia.org/wiki/Portal:Current\_events . Accessed: 2019-05-22
- 15. G.B. Tran, M. Alrifai, in Proceedings of the 23rd International Conference on World Wide Web (ACM, 2014), pp. 511-516

## Appendix: Tables 4-8

|   ID | Risk                                                  | Tag                     | Keyword                                   |
|------|-------------------------------------------------------|-------------------------|-------------------------------------------|
|    1 | Asset bubbles in a major economy                      | housing bubble          | housing, mortgage, estate                 |
|    1 | Asset bubbles in a major economy                      | stock bubble            | share, stock, exchange                    |
|    1 | Asset bubbles in a major economy                      | commodity bubble        | commodit-                                 |
|    1 | Asset bubbles in a major economy                      | asset bubble            | liquidity, asset                          |
|    2 | Deflation in a major economy                          | deflation               | deflation                                 |
|    2 | Deflation in a major economy                          | decline in prices       | price                                     |
|    3 | Failure of a major financial mechanism or institution | bank failure            | bank                                      |
|    3 | Failure of a major financial mechanism or institution | financial crisis        | financial                                 |
|    4 | Failure/shortfall of critical infrastructure          | oil/gas network failure | pipe                                      |
|    4 | Failure/shortfall of critical infrastructure          | water supply failure    | pipe                                      |
|    4 | Failure/shortfall of critical infrastructure          | power grid failure      | power, grid, electricity, blackout        |
|    4 | Failure/shortfall of critical infrastructure          | civil flight failure    | flight, airport, airline, plane, aircraft |
|    5 | Fiscal crises in key economies                        | sovereign debt crisis   | debt, loan, lend                          |
|    5 | Fiscal crises in key economies                        | liquidity crisis        | liquid                                    |
|    6 | High structural unemployment or underemployment       | unemployment            | employ, job                               |
|    7 | Illicit trade                                         | drug trade              | drug                                      |
|    7 | Illicit trade                                         | smuggling               | smuggl-                                   |
|    7 | Illicit trade                                         | tax evasion             | tax                                       |
|    7 | Illicit trade                                         | money laundering        | launder                                   |
|    7 | Illicit trade                                         | human trafficking       | trafficking                               |
|    7 | Illicit trade                                         | counterfeiting          | counterfeit                               |
|    8 | Severe energy price shock                             | energy price shock      | price, oil, gas                           |
|    9 | Unmanageable inflation                                | inflation               | inflation                                 |
|    9 | Unmanageable inflation                                | rising good price       | price                                     |

Table 4 Economic risks and subordinate tags. Each tag corresponds to a list of the roots of keywords.

|   ID | Risk                                                | Tag                       | Keyword                              |
|------|-----------------------------------------------------|---------------------------|--------------------------------------|
|   10 | Extreme weather events                              | storm                     | hurricane, storm, typhoon, cyclone   |
|   10 | Extreme weather events                              | blizzard                  | snow, blizzard, hailstone            |
|   10 | Extreme weather events                              | torrential rain           | rain                                 |
|   10 | Extreme weather events                              | flood                     | flood                                |
|   11 | Failure of climate-change mitigation and adaptation | death                     | death, dead, die, toll, kill, corpse |
|   11 | Failure of climate-change mitigation and adaptation | missing                   | missing, disappear                   |
|   11 | Failure of climate-change mitigation and adaptation | injury                    | injur-, hurt, wound                  |
|   11 | Failure of climate-change mitigation and adaptation | homeless                  | home                                 |
|   11 | Failure of climate-change mitigation and adaptation | damage                    | collaps, damage, destory             |
|   11 | Failure of climate-change mitigation and adaptation | economic loss             | cost, loss, dollar, usd, euro, $ , e |
|   12 | Major biodiversity loss and ecosystem collapse      | ecosystem collapse        | ecosystem                            |
|   12 | Major biodiversity loss and ecosystem collapse      | biodiversity loss         | biodiversity, species, wildlife      |
|   13 | Major natural disasters                             | earthquake                | earthquake, temblor                  |
|   13 | Major natural disasters                             | volcanic activity         | volcan-                              |
|   13 | Major natural disasters                             | tsunami                   | tsunami                              |
|   13 | Major natural disasters                             | landslide                 | slide                                |
|   13 | Major natural disasters                             | natural wildfire          | wildfire                             |
|   14 | Man-made environmental damage and disasters         | radioactive contamination | radioact-                            |
|   14 | Man-made environmental damage and disasters         | environment contamination | contamin-                            |
|   14 | Man-made environmental damage and disasters         | urban pollution           | pollution                            |
|   14 | Man-made environmental damage and disasters         | oil spill                 | oil, spill                           |
|   14 | Man-made environmental damage and disasters         | manmade wildfire          | wildfire                             |

Table 5 Environmental risks and and their corresponding tags. Each tag must match at least one entry in the list of the roots of keywords.

Table 6 Geopolitical risks and and their corresponding tags. Each tag must match at least one entry in the list of the roots of keywords.

|   ID | Risk                                           | Tag                     | Keyword                                                  |
|------|------------------------------------------------|-------------------------|----------------------------------------------------------|
|   15 | Failure of national governance                 | corruption              | corruption                                               |
|   16 | Interstate conflict with regional consequences | trade war military war  | trade, currency military, invasion, occupation, conflict |
|   17 | Large-scale terrorist attacks                  | terrorist attack        | terror                                                   |
|   18 | State collapse or crisis                       | military coup civil war | coup civil, war                                          |
|   19 | Weapons of mass destruction                    | nuclear weapon          | nuclear                                                  |

Table 7 Societal risks and and their corresponding tags. Each tag must match at least one entry in the list of the roots of keywords.

|   ID | Risk                                            | Tag                 | Keyword                                         |
|------|-------------------------------------------------|---------------------|-------------------------------------------------|
|   20 | Failure of urban planning                       | urban pollution     | pollution                                       |
|   20 | Failure of urban planning                       | factory explosion   | factory                                         |
|   20 | Failure of urban planning                       | building collapse   | collapse                                        |
|   21 | Food crises                                     | starvation          | starv-, hunger, famin-                          |
|   21 | Food crises                                     | crop destruction    | crop, agricult-                                 |
|   21 | Food crises                                     | low quality of food | poison, taint, contaminat-, poultry, meat, pork |
|   21 | Food crises                                     | rising food price   | price                                           |
|   21 | Food crises                                     | food shortage       | shortage, suppl-                                |
|   22 | Large-scale involuntary migration               | evacuation          | evacuat-, evacuee                               |
|   22 | Large-scale involuntary migration               | refugee flee        | refugee, flee                                   |
|   22 | Large-scale involuntary migration               | migration           | migrant, migrate                                |
|   22 | Large-scale involuntary migration               | eviction            | evict                                           |
|   23 | Profound social instability                     | riot                | riot                                            |
|   23 | Profound social instability                     | unrest              | unrest                                          |
|   23 | Profound social instability                     | demonstration       | demonstration                                   |
|   23 | Profound social instability                     | march               | march                                           |
|   23 | Profound social instability                     | revolution          | revolution                                      |
|   24 | Rapid and massive spread of infectious diseases | avian influenza     | bird, avian, h5n1, h6n1, h7n9                   |
|   24 | Rapid and massive spread of infectious diseases | swine influenza     | h1n1, swine                                     |
|   24 | Rapid and massive spread of infectious diseases | equine influenza    | equine                                          |
|   24 | Rapid and massive spread of infectious diseases | aids                | aids, hiv                                       |
|   24 | Rapid and massive spread of infectious diseases | cholera             | cholera                                         |
|   24 | Rapid and massive spread of infectious diseases | fever               | fever                                           |
|   24 | Rapid and massive spread of infectious diseases | diarrhea            | diarrhea                                        |
|   24 | Rapid and massive spread of infectious diseases | ebola               | ebola                                           |
|   24 | Rapid and massive spread of infectious diseases | epidemic            | epidemic, outbreak, pandemic                    |
|   25 | Water crises                                    | water shortage      | thirst, shortage, deprivat-, suppl-             |
|   25 | Water crises                                    | water contamination | water                                           |

Table 8 Technological risks and and their corresponding tags. Each tag must match at least one entry in the list of the roots of keywords.

|   ID | Risk                                             | Tag                       | Keyword                  |
|------|--------------------------------------------------|---------------------------|--------------------------|
|   26 | Adverse consequences of technological advances   | genetically modified food | genetic                  |
|   26 | Adverse consequences of technological advances   | radioactive contamination | radioact-                |
|   26 | Adverse consequences of technological advances   | pyrotechnics              | pyrotech-                |
|   27 | Breakdown of critical information infrastructure | internet blackout         | internet                 |
|   27 | Breakdown of critical information infrastructure | satellite break           | satellite                |
|   28 | Large-scale cyberattacks                         | cyberattack               | cyber                    |
|   28 | Large-scale cyberattacks                         | malware                   | malware                  |
|   28 | Large-scale cyberattacks                         | computer worm             | worm                     |
|   28 | Large-scale cyberattacks                         | software virus            | virus                    |
|   28 | Large-scale cyberattacks                         | trojan horse              | trojan                   |
|   28 | Large-scale cyberattacks                         | hacking attack            | hack                     |
|   28 | Large-scale cyberattacks                         | DOS attack                | denial                   |
|   28 | Large-scale cyberattacks                         | online attack             | online                   |
|   29 | Massive incident of data fraud/theft             | data leak                 | leak, classified, secret |
|   29 | Massive incident of data fraud/theft             | hacking data              | hack                     |
Xiang Niu Gyorgy Korniss Boleslaw K. Szymanski
Supervised Learning of the Global Risk Network Activation from Media Event Reports
The World Economic Forum (WEF) publishes annual reports on global risks which
have the high impact on the world's economy. Currently, many researchers
analyze the modeling and evolution of risks. However, few studies focus on
validation of the global risk networks published by the WEF. In this paper, we
first create a risk knowledge graph from the annotated risk events crawled from
the Wikipedia. Then, we compare the relational dependencies of risks in the WEF
and Wikipedia networks, and find that they share over 50% of their edges.
Moreover, the edges unique to each network signify the different perspectives
of the experts and the public on global risks. To reduce the cost of manual
annotation of events triggering risk activation, we build an auto-detection
tool which filters out over 80% media reported events unrelated to the global
risks. In the process of filtering, our tool also continuously learns keywords
relevant to global risks from the event sentences. Using locations of events
extracted from the risk knowledge graph, we find characteristics of
geographical distributions of the categories of global risks.