Evidence assignment

Course resources

Report on the shared investigation from classes 1–5. This report is part of Assignments, which together contribute 30% of the course grade. Complete the manual investigation before comparing it with an agent in class 5. Submit at the evidence assignment page before class 6 (November 17, 14:40 JST).

Submit one short report

Submit the report as Markdown (.md) or plain text (.txt), the report formats accepted by the submission page. If you worked in a notebook or document, copy the following six items, including commands and results, into the .md or .txt file:

  1. A focused question and your initial prediction
  2. The source work and Soranoha URL, or your author’s ZIP name and the rows in works.csv for the works that you quoted; the edition or supplied filename (if you used a linguistic analyzer, its dictionary name and version)
  3. Two reproducible commands, with their outputs or counts and the unit counted
  4. Two or three short source passages with part, actor, direction, factuality judgment, evidence, and interpretation, including at least one missed or misleading example
  5. One claim made by the agent, with the command and passage cited for it; how you reran the command and checked the source; and the outcome (agreement, disagreement, or unresolved) with the reason
  6. A conclusion limited to the evidence, plus one change to improve the investigation

For each item, you can use the records that you already have.

Item Record to use
1 “Question and prediction” in your evidence record (class 4 homework)
2 “Source” in your evidence record; README.txt and works.csv in your author’s folder
3 “Method” and “Result” in your evidence record
4 CSV rows 1–12; “Passages checked” and “Limits and open judgments” in your evidence record
5 “Checked claim” and “Checked quotation” in your class 5 exit note
6 “Limits and open judgments” and “To repeat this” in your evidence record

The report can be brief: the equivalent of one or two pages is enough if another student can follow the evidence. If an agent is unavailable, save your manual work and use the recorded investigation in class 5 section 2 for the comparison. For item 5, record only interactions and checks that you actually carried out, and choose a claim other than those checked in the 「疑惑」 example in class 5 section 4, the class 5 exit-note example, and the example report below.

What does a completed report look like?

This example report uses Dazai Osamu’s corpus from class 4 and, for item 5, Claude Code’s recording B from class 5, as a student without an agent would. It shows one reading; your report uses your own question, records, and checks.

Item Example entry
1. Question and prediction In Dazai Osamu’s 56 selected works, does 落ちる combine with 来る more often than with 行く? Prediction: yes, as in Akutagawa’s 70 works (10 to 1), because falling things come toward a person on the ground
2. Source class4-dazai.zip: 56 works from Soranoha release c373bb08… (full value in README.txt), analyzed with the novel UniDic unidic-novel-202512, searched with ling 0.7.0. Quoted works: the rows for Dazai_O_Nijusseiki.md (「二十世紀旗手」, 000234_000035) and Dazai_O_Hifutokokoro.md (「皮膚と心」, 000267_000035) in works.csv
3. Commands and counts ling summarize --corpus dazai.lingcorpus --patterns class4.lx --top all > summary.txt, then grep -w deixis summary.txt and search for "落ちる": one row, 落ちる + 行く 3 tokens; no row for 来る, so 0. With 40,757 VERB tokens, the rate is 0.7 per 10,000 verbs. ling matches --corpus dazai.lingcorpus --tsv --context 12 --pattern '[lemma=落ちる] [lemma=て] [lemma in {来る, 行く}].': 3 matches in 2 works
4. Passages Part (work title) 「二十世紀旗手」, sentences 47 and 48, だんだん下に落ちて行く: actor, people in general (「人みな同じ」); direction, down; factuality, happens / happened (CT+); evidence, 「五段落して、それから、さっと三段あげる」; a fall in rank, not a movement of a body, so this match is misleading for a count of falls. Part (work title) 「皮膚と心」, sentence 271, エンマの、こうして落ちて行く路: actor, Emma in 『ボヴァリイ夫人』, which the narrator is reading; direction, down; factuality, happens / happened (CT+); evidence, 「エンマの苦しい生涯」; a decline in a life, not a fall. Missed forms checked: a gap between て and 来る/行く ([]{1,2}) and compound verbs ending in 落ちる followed by て and 来る/行く (0 matches each); the other 63 落ちる tokens were not read
5. Agent claim The claim checked in my class 5 exit note, from Claude Code’s recording B (Claude Code 2.1.321, claude-opus-5-5, November 10, 2026): 落ちて来る is 10 tokens in 6 works, and 落ちて行く 1 token in 1 work, 「捨児」, whose sentence the answer quotes. Rerun: ling matches --corpus akutagawa.lingcorpus --tsv --limit all --pattern '[lemma=落ちる] [lemma=て] [lemma=来る].', then listing the distinct file names in column 3: 6 files; with [lemma=行く]: 1 file, Akutagawa_R_Sutego.md. The quotation 「とうとう家産を蕩尽して、夜逃げ同様横浜へ落ちて行く事になりました。」 matches the paragraph. Outcome: agreement, with works counted as files
6. Conclusion and next change In Dazai’s 56 selected works, 落ちる + て combines with 行く in 3 tokens across 2 works and with 来る in 0 tokens; all three describe a decline, not a physical fall. The prediction is not supported, but three figurative matches cannot show how Dazai describes physical falls. Next change: label all 66 落ちる tokens as physical or figurative before comparing 来る and 行く

Check an agent’s work

Instruct an agent to investigate your focused question using the supplied files. Ask it to show its commands, counting unit, and source passages. Read commands before approving them.

Rerun the command supporting one claim. Check the cited passage against the source.

Record the agent and tool names and date. Do not rely on an explanation alone; check the commands and outputs directly.

What does a checked search claim look like?

Question: Does a string search for のぼ find every expression of climbing in part 二?

Prediction: This search should find inflected forms of のぼる written in hiragana, but it may miss climbing described with other verbs.

grep -oF 'のぼ' story.txt | wc -l
grep -nF 'のぼ' story.txt

In the distributed story.txt, のぼ occurs 12 times on 5 lines, all in part 二. One occurrence is part of あのぼんやり and does not express movement. In the passage about the sinners climbing out of the blood pond, 這い上って does not contain のぼ, so this search does not find it.

The passage のぼれなくなってしまいました also matches, but marks inability to continue climbing. Twelve matches do not mean that twelve climbing events occurred.

Assessment criteria

The instructor evaluates whether the question is clear, the source and commands can be traced, the counting unit is accurate, the interpretations are supported by passages, and an agent’s claim is checked against the command output and the text.

Assessment criteria and final project requirements are in the course guide.

Search the course pages