HATHI 1M: Introducing a Million Page Historical Prose Dataset in English from the Hathi Trust
<|begin_of_text|><|start_header_id|>system<|end_header_id|> You are a research archivist expert in dataset metadata. Answer the question truthfully.  <|eot_id|><|start_header_id|>user<|end_header_id|> Here is the Description of a dataset. Description:'We release a new dataset of 1,660,401 randomly sampled pages of English-language prose from the Hathi Trust. It is roughly divided between modes of fictional and non-fictional writing and published between the years 1800 and 2000. In addition to focusing on the 'page' as the basic bibliographic unit, our work employs a single predictive model for the historical period under consideration in contrast to prior work. In addition to providing publication metadata, we also provide an enriched feature set of 109 features including part-of-speech, sentiment scores, word 'super-senses' and more. Our data is designed to give researchers in the digital humanities large yet portable random samples of historical writing across two foundational modes of English prose writing' . Please return only a json list of at most 3 Keywords corresponding to the Description:.<|eot_id|><|start_header_id|>assistant<|end_header_id|> {"Answer" : ["digital humanities, cultural heritage"]} <|eot_id|>
 Here is the Description of a dataset. Description:'We release a new dataset of 1,660,401 randomly sampled pages of English-language prose from the Hathi Trust. It is roughly divided between modes of fictional and non-fictional writing and published between the years 1800 and 2000. In addition to focusing on the 'page' as the basic bibliographic unit, our work employs a single predictive model for the historical period under consideration in contrast to prior work. In addition to providing publication metadata, we also provide an enriched feature set of 109 features including part-of-speech, sentiment scores, word 'super-senses' and more. Our data is designed to give researchers in the digital humanities large yet portable random samples of historical writing across two foundational modes of English prose writing' . Please return only a json list of at most 3 Keywords corresponding to the Description:.
We release a new dataset of 1,660,401 randomly sampled pages of English-language prose from the Hathi Trust. It is roughly divided between modes of fictional and non-fictional writing and published between the years 1800 and 2000. In addition to focusing on the 'page' as the basic bibliographic unit, our work employs a single predictive model for the historical period under consideration in contrast to prior work. In addition to providing publication metadata, we also provide an enriched feature set of 109 features including part-of-speech, sentiment scores, word 'super-senses' and more. Our data is designed to give researchers in the digital humanities large yet portable random samples of historical writing across two foundational modes of English prose writing
digital humanities, cultural heritage