自然言語処理の主なタスク
“I desire you will do no such thing. Lizzy is not a bit better than the others; and I am sure she is not half so handsome as Jane, nor half so good-humoured as Lydia. But you are always giving her the preference.”を
" I desire you will do no such thing . Lizzy is not a bit better than the others ; and I am sure she is not half so handsome as Jane, nor half so good-humoured as Lydia . But you are always giving her the preference . ”“I desire you will do no such thing. Lizzy is not a bit better than the others; and I am sure she is not half so handsome as Jane, nor half so good-humoured as Lydia. But you are always giving her the preference.”を
“ I desir you will do no such thing . lizzi is not a bit better than the other ; and I am sure she is not half so handsom as jane , nor half so good - humour as lydia . but you are alway give her the prefer . ”(NLTKのPorter Stemmerを使用)
“I desire you will do no such thing. Lizzy is not a bit better than the others; and I am sure she is not half so handsome as Jane, nor half so good-humoured as Lydia. But you are always giving her the preference.”を
" -PRON- desire -PRON- will do no such thing . Lizzy be not a bit well than the other ; and -PRON- be sure -PRON- be not half so handsome as Jane , nor half so good - humoured as Lydia . but -PRON- be always give -PRON- the preference . "(-PRON-はSpacyのlemmaとして代名詞を示す)
他にも
Test stringとして下記のテキストをペースト（Pride and Prejudiceの冒頭から）
“My dear Mr. Bennet,” said his lady to him one day, “have you heard that Netherfield Park is let at last?” Mr. Bennet replied that he had not. “But it is,” returned she; “for Mrs. Long has just been here, and she told me all about it.” Mr. Bennet made no answer. “Do you not want to know who has taken it?” cried his wife impatiently. “You want to tell me, and I have no objection to hearing it.” This was invitation enough.