Changeset 157:aa28bbe9592e for classifier/tokenizer

Timestamp:

08/18/07 10:11:42 (13 months ago)

Author:

Tarek Ziad?? <tarek@…>

Message:

first move to recode the package

Location:

classifier/tokenizer

Files:

• __init__.py (added)
• filters.py (added)
• normalized.fr.txt (added)
• normalized.txt (added)
• stopwords.fr.txt (added)
• stopwords.txt (added)
• tests.py (added)
• tokenizer.txt (added)