Projects: pypi: tokenizers
https://packages.ecosyste.ms/registries/pypi.org/packages/tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
83 versions
Latest release: over 2 years ago
224 dependent packages
15,090,551 downloads last month
Enhanced Analysis
Educational Contributors:
taufiquzzaman.peyash@northsouth.edu
mishig.davaadorj@coloradocollege.edu
kaito_sugimoto@nii.ac.jp
a.m.sathe@sms.ed.ac.uk
yasuoka@kanji.zinbun.kyoto-u.ac.jp
Repository Activity:
Repository Owner:
Hugging Face (organization)
The AI community building the future. Institutional
The AI community building the future. Institutional
README Analysis:
CITATION.cff
Science Score: 100/100
Starting Score: 100 points
Bonuses:
-
+100
Educational commit emails
5 contributors with educational email addresses -
+15
Institutional repository owner
Repository owned by research institution -
+2
Science terms in README
1 scientific terms found in README -
+15
CITATION.cff file
Contains citation file for academic attribution
Penalties:
-
-10
PyPI ecosystem
General-purpose ecosystem -
-10
No science terms in description
No scientific terms found in description
Very Likely Science (100)
Papers Mentioning tokenizers 1
10.3389/fphys.2020.00845
Dynamic Courtship Signals and Mate Preferences in Sepia plangonCited by: 5
Author(s): Alejandra López Galán, Wen-Sung Chung, N. Justin Marshall
Software Mentions: 11
Published: over 5 years ago