Skip to content
/ Douban-Dushu-Dataset Public
  • Notifications You must be signed in to change notification settings
  • Fork 6
  • Star 57

A dataset contains 37 million douban dushu comments

57 stars 6 forks Branches Tags Activity
Star
Notifications You must be signed in to change notification settings

JaniceZhao/Douban-Dushu-Dataset

Branches Tags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
.DS_Store
.DS_Store
 
 
._.DS_Store
._.DS_Store
 
 
._README.md
._README.md
 
 
._application form.pdf
._application form.pdf
 
 
README.md
README.md
 
 
application form.pdf
application form.pdf
 
 

Repository files navigation

Dateset Description

DouBan DuShu is a Chinese website where users can share their reviews about various kinds of books. Most of the users in this website are unprofessional book reviewers. Therefore, the comments are usually spoken Chinese or even Internet slang.

In addition to the comments, users can mark the books from one star to 5 stars according to the quality of the books. We have collected more than 37 million short comments from about 18 thousand books with 1 million users. The great number of users provide diversity of the language styles, from moderate formal to informal. An example of the data item is shown in the following table.

Key Description Value Example
Book Name The name of the book 理想国
User Name Who gives the comment 399
Tag The tag the book belongs to 思想
Comment Content of the comment 我是国师的脑残粉
Star Stars given to the book (from 1 star to 5 stars) 5 stars
Date When the comment posted 2018-08-21
Like Count of "like" on the comment 0

Data Preprocessing

  1. convert full width symbols to half width symbols
  2. remove some special symbols
  3. convert traditional Chinese to simplified Chinese

Terms of Use:

  1. Respect the privacy of personal information of the original source
  2. The original copyright of all the data belongs to writers of the reviews and DouBan
  3. The dataset is only for study and research purposes. Without permission, it may not be used for any commercial purposes
  4. Redistribution is NOT allowed
  5. Some items must be deleted if the copyright owners claim
  6. If you want to use the dataset for depth study, please cite this paper:
@article{zhao2018lsicc,
  title={LSICC: A Large Scale Informal Chinese Corpus},
  author={Zhao, Jianyu and Ji, Zhuoran},
  journal={arXiv preprint arXiv:1811.10167},
  year={2018}
}

Date Download

You had to agree to the terms and conditions above before you download and use this corpus.

Due to the large size of the corpus, we divide the whole dataset to 4 CSV files.

  1. Google Drive: link
  2. Baidu Cloud: link Extraction Code: vpik

License

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.

About

A dataset contains 37 million douban dushu comments

Topics

dataset recommendation-system chinese-nlp sentiment-classification

Resources

Readme
Activity

Stars

57 stars

Watchers

3 watching

Forks

6 forks
Report repository

Releases

No releases published

Packages

No packages published

Footer

© 2024 GitHub, Inc.

装修网无尘洁净室装修装修如何验收装饰装潢常州装修公司公装怎么样房子装修3室一厅精装修报价蒙自装修简单装修客厅蛋糕店简装需要多少钱布鲁装饰简装灯具效果图大全简装的房子多久可以入住室内地装修酒店装修装潢公司厂区装修350装修平台家装砌墙价格餐厅中式装修室内装修家用网线公装装饰公司怎么样室内70平简装多少钱90平方简装的话大概多少钱绵阳口碑好的装修2020年装修吉日查询南京十大装修公司排名日照家装装饰泰禾金府大院装修老房装修哪家好毛坯房简装要多少钱简装新风系统香港通过《维护国家安全条例》两大学生合买彩票中奖一人不认账让美丽中国“从细节出发”19岁小伙救下5人后溺亡 多方发声汪小菲曝离婚始末卫健委通报少年有偿捐血浆16次猝死单亲妈妈陷入热恋 14岁儿子报警雅江山火三名扑火人员牺牲系谣言手机成瘾是影响睡眠质量重要因素男子被猫抓伤后确诊“猫抓病”中国拥有亿元资产的家庭达13.3万户高校汽车撞人致3死16伤 司机系学生315晚会后胖东来又人满为患了男孩8年未见母亲被告知被遗忘张家界的山上“长”满了韩国人?倪萍分享减重40斤方法许家印被限制高消费网友洛杉矶偶遇贾玲何赛飞追着代拍打小米汽车超级工厂正式揭幕男子被流浪猫绊倒 投喂者赔24万沉迷短剧的人就像掉进了杀猪盘特朗普无法缴纳4.54亿美元罚金周杰伦一审败诉网易杨倩无缘巴黎奥运专访95后高颜值猪保姆德国打算提及普京时仅用姓名西双版纳热带植物园回应蜉蝣大爆发七年后宇文玥被薅头发捞上岸房客欠租失踪 房东直发愁“重生之我在北大当嫡校长”校方回应护栏损坏小学生课间坠楼当地回应沈阳致3死车祸车主疑毒驾事业单位女子向同事水杯投不明物质路边卖淀粉肠阿姨主动出示声明书黑马情侣提车了奥巴马现身唐宁街 黑色着装引猜测老人退休金被冒领16年 金额超20万张立群任西安交通大学校长王树国卸任西安交大校长 师生送别西藏招商引资投资者子女可当地高考胖东来员工每周单休无小长假兔狲“狲大娘”因病死亡外国人感慨凌晨的中国很安全恒大被罚41.75亿到底怎么缴考生莫言也上北大硕士复试名单了专家建议不必谈骨泥色变“开封王婆”爆火:促成四五十对测试车高速逃费 小米:已补缴天水麻辣烫把捣辣椒大爷累坏了

装修网 XML地图 TXT地图 虚拟主机 SEO 网站制作 网站优化