Pinned Loading

1. trafilatura trafilatura Public

   Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

   Python 4.5k 304

2. htmldate htmldate Public

   Fast and robust date extraction from web pages, with Python or on the command-line

   Python 136 27

3. simplemma simplemma Public

   Simple multilingual lemmatizer for Python, especially useful for speed and efficiency

   Python 168 14

4. rust-primes rust-primes Public

   Rust code and command-line utility to compute and visualize prime sequences

   Rust 1 1

5. courlan courlan Public

   Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters

   Python 142 9

6. German-NLP German-NLP Public

   Curated list of open-access/open-source/off-the-shelf resources and tools developed with a particular focus on German

   492 66