MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。
-
Updated
Jul 22, 2025
#
corpus-data
Here are 172 public repositories matching this topic...
ChatGPT 中文语料库 对话语料 小说语料 客服语料 用于训练大模型
-
Updated
May 15, 2024
地球上最全的华语现代诗歌语料库，3k+诗人，80K+诗歌，15M+字
-
Updated
Jan 3, 2025 - Python
A curated list of Open Information Extraction (OIE) resources: papers, code, data, etc.
nlp data-science natural-language-processing big-data ai nlu extract-information information-extraction datascience dataset papers corpus-data nlp-apis nlp-resources openie relation-extraction natural-language-understanding open-information-extraction literature-review oie-systems
-
Updated
Oct 25, 2022
chinese NLP corpus of chinese science fiction,chinese science fiction corpus : About 4675 Chinese science fiction novels 大约有4675本科幻小说，中文科幻小说自然语言处理语料库，中文科幻小说文本语料库，中文科幻小说文本数据库，科幻小说语料
nlp corpus science-fiction scifi chinese-nlp corpus-data datasets nlp-resources nlp-machine-learning nlp-datasets
-
Updated
Oct 22, 2022
UA-GEC: Grammatical Error Correction and Fluency Corpus for the Ukrainian Language
natural-language-processing corpus dataset corpus-data corpus-tools gec nlp-datasets grammatical-error-correction ukrainian-language
-
Updated
Feb 11, 2024 - Macaulay2
chinese NLP corpus of chinese science fiction, chinese science fiction corpus: Archive of the Ark Plan of Ula Science Fiction Website 乌拉科幻小说网方舟计划存档，中文科幻小说自然语言处理语料库，中文科幻小说文本语料库，中文科幻小说文本数据库，科幻小说语料
nlp corpus science-fiction scifi chinese-nlp corpus-data datasets nlp-resources nlp-machine-learning nlp-datasets
-
Updated
Oct 22, 2022
文本去重
-
Updated
May 23, 2024 - Python
Utilities for Processing the Switchboard Dialogue Act Corpus
dialogue corpus corpus-data corpus-tools switchboard dialogues corpus-processing dialogue-data switchboard-corpus dialogue-act
-
Updated
Jan 24, 2021 - Python
DANeS is an open-source E-newspaper dataset by collaboration between DATASET JSC (dataset.vn) and AIV Group (aivgroup.vn)
open-source machine-learning natural-language-processing corpus artificial-intelligence dataset newspaper corpus-data text-sentiment danes datasetvn aivgroup
-
Updated
May 11, 2022 - Python
ParlaMint: Comparable Parliamentary Corpora
-
Updated
Jul 21, 2025 - XSLT
Biomedical NLP Corpus or Datasets.
nlp natural-language-processing text-mining bioinformatics dataset named-entity-recognition corpus-data medical-informatics
-
Updated
Apr 26, 2022
A parser for annotated MuseScore 3 files.
tsv parser corpus xml-parsing xml-parser corpus-data music-score sheet-music musescore music-scores corpus-generator corpus-tools xml-parser-library corpus-processing tsv-format musescore2 tsv-files musescore3 sheet-music-parser musescore4
-
Updated
Mar 25, 2025 - Python
CCNC: A Comprehensive Chinese Name Corpus (3.65M name samples). 大型中文姓名语料库 (内含365万姓名语例)。
-
Updated
Jun 28, 2021 - Jupyter Notebook
粵文語料篩選器 Cantonese text filter
-
Updated
Mar 31, 2025 - Python
Improve this page
Add a description, image, and links to the corpus-data topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the corpus-data topic, visit your repo's landing page and select "manage topics."