Changeset 225:8ae6a7d30952 for xap/trunk/xapindexer.py
- Timestamp:
- 03/21/08 18:47:33 (8 months ago)
- Files:
-
- 1 modified
-
xap/trunk/xapindexer.py (modified) (1 diff)
Legend:
- Unmodified
- Added
- Removed
-
xap/trunk/xapindexer.py
r224 r225 52 52 logging.debug('xap:indexing %s' % uid) 53 53 options = {'treshold': 2} 54 if isinstance(text, str):55 text = text.decode('utf8')56 54 words = tokenize(text, options=options) 57 55 if language is not None:
