Commit d6b2622
jb-kerboeuf
french tokenization
Hi Bruce ! I made some changes in the source code that affect only the tokenaztion when language=french
I changed to things : particles before an apostrophe, and numeral adjectives like 1st and 3rd.
Hope it helps a little.1 parent d9ec4cf commit d6b2622
1 file changed
+2219
-2198
lines changed
0 commit comments