Child pages
  • Use Case: Perform Text Analytics Using Topic Explorer

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

This use case obtains some HTRC volume content, builds topic models based on the content, and then visualizes the topic models in a web browser.

VM Mode

This use case can be run in only secure mode in the VM. To export experiment results out of the VM, you need to release the result files in secure mode, and then receive results via email.

Example Use

First, switch the VM mode to secure mode (done in the HTRC portal). 

In the VM, start a Terminal, and change directory to the htrc-data folder

Code Block
languagebash
cd ~/demo/htrc-data/home/dcuser/HTRC-Demos/Python/topicexplorer-demo

List the files of this folder

Code Block
languagebash
ls
 

Following are the files related to this analysis.

  •  htrc-demo.sh - This is the script for topic modeling analysis.
  • htrc-id - This file contains the list of volume ids. 

Run the topic modeling analysis

...

It will take quite a while to finish the topic modeling due to the nature of this kind of computation. After the topic modeling process is done, you can view the result through the browser. (The browser will be automatically opened for you). Image RemovedClick on the "Topic" button.

Image Added 


Image RemovedImage Added

You will find the scripts run into errors if the VM is in maintenance mode. It is because this use case fetches HTRC content by using the Data API, which is only accessible in the secure mode. 

This demo code:

  • loads data from 3 volumes in HathiTrust using the HTRC Data API
  • builds an LDA topic model from the corpus
  • save the LDA trained model
  • view topics in a web browser in an interactive way

Here are the scripts used in this example: topicexplorer-demo.zip