-
Notifications
You must be signed in to change notification settings - Fork 64
Open
Labels
documentationImprovements or additions to documentationImprovements or additions to documentationenhancementNew feature or requestNew feature or request
Description
As requested in #41, here is how I succeeded in running contextualSpellCheck for French.
Use French spaCy model:
nlp = spacy.load("fr_core_news_sm")
Use camembert/camembert-base-ccnet
:
nlp.add_pipe("contextual spellchecker", config={"max_edit_dist": 4,"model_name": "camembert/camembert-base-ccnet"})
Need these dependencies:
pip install sentencepiece
pip install protobuf==3.20
Remark: on the result spaces are lost, thus need a post-processing to get them back properly.
PS: for flaubert/flaubert_large_cased
model, need this dependency
pip install sacremoses
mtx-z
Metadata
Metadata
Assignees
Labels
documentationImprovements or additions to documentationImprovements or additions to documentationenhancementNew feature or requestNew feature or request