Changeset 159:e4e3160be9c0 for classifier/tokenizer/filters.py

Timestamp:

08/19/07 10:34:17 (13 months ago)

Author:

Tarek Ziad?? <tarek@…>

Message:

refactoring in progress

Files:

• classifier/tokenizer/filters.py (modified) (1 diff)

classifier/tokenizer/filters.py

@@ -157 +157 @@
         lang = options['lang']
         stopwords = self._getStopWords(lang)
+        if 'treshold' in options:
+            tres = options['treshold']
+        else:
+            tres = self.treshold
+
         return [word for word in text if (word not in stopwords
-                and len(word) > self.treshold)]
+                and len(word) > tres)]
 
 registerFilter(StopWords())