python 对英文句子分词 ，去重，排序（csdn）————程序.pdf

题目：给定如下一段英文

A major drawback of cross-network recommender solutions is that they

can only be applied to users that are overlapped across networks.

Thus, the non-overlapped users, which form the majority of users are

ignored. As a solution, we propose CnGAN, a novel multi-task learning

based recommend architecture。

编写一个函数，要求实现以下功能：1）统计有多少个不同的单词；2）根据每

个单词 ASCII 码值的和（单词 they ASCII 码值的和是：

典函数，再对字典利用可以值进行排序。

实验步骤：

1 分词函数 Qie§

def Qie(p):

words = [] # 建立一个空列表

index = 0 # 遍历所有的字符

start = 0 # 记录每个单词的开始位置

while index < len(p): # 当 index 小于 p 的长度

start = index # start 来记录位置

while p[index] != " " and p[index] not in[".", ","]: # 若不

break

# 判断如果是空格，或者是 . ,都要加上一，但是不写入 words

while p[index] == " " or p[index] in [".", ","]:

index += 1

if index ==len(p):

break

# 将 list 转换为 set 利用 set 的性质 进行去重