词向量和神经网络语言模型
离散表示( one-hot representation )
"John":1
"likes":2
"to":3
“watch”4
"movies":5
"also":6
"football":7
"games":8
"Mary":9
"too":10
John:[1,0,0,0,0,0,0,0,0,0]
likes:[0,1,0,0,0,0,0,0,0,0]
...
too: [0,0,0,0,0,0,0,0,0,1]
稀疏 √
维度爆炸 √
孤立语义 √
!" #$$%&'('#)(*&