C.2 Database Design C.2.1 Initial database design The initial database design shows that the URL and title are directly stored from each article and the RedditID is found using the PRAW API. Seeds are generated from the content using NLTK and the adjacency list shows which articles are related to each other to help with clustering. In order to illustrate our database design, Table C1 shows example articles found on Reddit’s site. Table C1: Initial Database Design with Examples Article Adjacency URL Title RedditID Seed Number List Trump comment [Trump, Sweden, about Orlando Melbourne 1 immigration 5uxy5e International Airport, {1: 3} "problems" immigration baffles Sweden problems] Sea ice at [Sea ice, Arctic, record low in Antarctic, Rod 5uy20e {2} 2 Arctic and Downie, World Wide Antarctic Fund for Nature] France is fed up with Trump's [France, Trump, 3 "repeated 5uxps4 {3: 1} attacks, weaken] attacks" to weaken Europe C.3 Detailed Components/Tools Linux Server A Linux based server will host the automated processing scripts for our crawler. This system will contain our database, Python scripts, and a Web Application. Python Scripting The server-side code handles the crux of our computational needs. Phase one and phase two of the design will be handled using individual Python scripts. By fragmenting our design it
C.2 Database Design C.2.1 Initial database design The initial database design shows that the URL and title are directly stored from each article and the RedditID is found using the PRAW API. Seeds are generated from the content using NLTK and the adjacency list shows which articles are related to each other to help with clustering. In order to illustrate our database design, Table C1 shows example articles found on Reddit’s site. Table C1: Initial Database Design with Examples Article Number URL Title RedditID Seed Adjacency List 1 Trump comment about immigration "problems" baffles Sweden 5uxy5e [Trump, Sweden, Orlando Melbourne International Airport, immigration problems] {1: 3} 2 Sea ice at record low in Arctic and Antarctic 5uy20e [Sea ice, Arctic, Antarctic, Rod Downie, World Wide Fund for Nature] {2} 3 France is fed up with Trump's "repeated attacks" to weaken Europe 5uxps4 [France, Trump, attacks, weaken] {3: 1} C.3 Detailed Components/Tools Linux Server A Linux based server will host the automated processing scripts for our crawler. This system will contain our database, Python scripts, and a Web Application. Python Scripting The server-side code handles the crux of our computational needs. Phase one and phase two of the design will be handled using individual Python scripts. By fragmenting our design it
GEDreport.docx