python正向最大匹配分词和逆向最大匹配分词_逆向最大匹配法资源-CSDN文库

需积分: 41 9 浏览量 2018-10-12 11:06:14 上传评论 1 收藏 19KB DOCX 举报

资源推荐

资源详情

资源评论

python 正向最大匹配分词和逆向最大匹配分词

正向最大匹配

1. # -*- coding:u-8 -*-

2.

3. CODEC='u-8'

4.

5. def u(s, encoding):

6. 'converted other encoding to unicode encoding'

7. if isinstance(s, unicode):

8. return s

9. else:

10. return unicode(s, encoding)

11.

12. def fwd_mm_seg(wordDict, maxLen, str):

13. 'forward max match segment'

14. wordList = []

15. segStr = str

16. segStrLen = len(segStr)

17. for word in wordDict:

18. print 'word: ', word

19. print ""

20. while segStrLen > 0:

21. if segStrLen > maxLen:

22. wordLen = maxLen

23. else:

24. wordLen = segStrLen

25. subStr = segStr[0:wordLen]

26. print "subStr: ", subStr

27. while wordLen > 1:

28. if subStr in wordDict:

29. print "subStr1: %r" % subStr

30. break

31. else:

32. print "subStr2: %r" % subStr

33. wordLen = wordLen - 1

34. subStr = subStr[0:wordLen]

35. # print "subStr3: ", subStr

36. wordList.append(subStr)

37. segStr = segStr[wordLen:]

38. segStrLen = segStrLen - wordLen

39. for wordstr in wordList:

本内容试读结束，登录后可阅读更多

下载后可阅读完整内容，剩余2页未读，立即下载

内容反馈

weixin_42466538

粉丝: 99
资源: 8

最新资源

资源上传下载、课程学习等过程中有任何疑问或建议，欢迎提出宝贵意见哦~我们会及时处理！点击此处反馈

feedback-tip