LiSCU: A Dataset for Character-Centric Narrative Understanding

Example from the book ....

About

When reading a literary piece, human readers often make inferences about various aspects of characters. While humans can readily draw upon their past experiences to build such a character-centric view of the narrative, understanding characters in narratives can be a challenging task for machines.

LiSCU is an English dataset of literature summaries paired with description of characters that appear in them. LiSCU is collected from various online study guides where the summaries and character descriptions are written by literary experts. It contains 9,499 summary-description pairs covering 1220 unique books with 5.6 characters per summary on average.

We introduce two new tasks on LiSCU: Character Identification and Character Description Generation. Our experiments with several state-of-the-art LLMs and human analyis show that there are plenty of room for improvement.


Tasks

Character Identification

Given a literature summary, a candidate list of characters that appear in the summary, and an anonymized character description, the goal in this task is to identify the character name described in the anonymized character description.

[Input] Book summary: Winston Smith is a member of the Outer Party. He works in the Records Department in the Ministry of Truth, rewriting and distorting history. To escape Big Brother's tyranny, at least inside his own mind, Winston begins a diary an act punishable by death. Winston is determined to remain human under inhuman circumstances. Yet telescreens are placed everywhere in his home, in his cubicle at work, in the cafeteria where he eats, even in the bathroom stalls. His every move is watched. No place is safe. One day, while at the mandatory Two Minutes Hate, Winston catches the eye of an Inner Party Member, O'Brien, whom he believes to be an ally. He also catches the eye of a dark-haired girl from the Fiction Department, whom he believes is his enemy and wants him destroyed. A few days later, Julia, the dark-haired girl whom Winston believes to be against him, secretly hands him a note that reads, "I love you." Winston takes pains to meet her, and when they finally do, Julia draws up a complicated plan whereby they can be alone. Alone in the countryside, Winston and Julia make love and begin their allegiance against the Party and Big Brother. Winston is able to secure a room above a shop where he and Julia can go for their romantic trysts. Winston and Julia fall in love, and, while they know that they will someday be caught, they believe that the love and loyalty they feel for each other can never be taken from them, even under the worst circumstances. Eventually, Winston and Julia confess to O'Brien, whom they believe to be a member of the Brotherhood (an underground organization aimed at bringing down the Party), their hatred of the Party. O'Brien welcomes them into the Brotherhood with an array of questions and arranges for Winston to be given a copy of "the book," the underground's treasonous volume written by their leader, Emmanuel Goldstein, former ally of Big Brother turned enemy. Winston gets the book at a war rally and takes it to the secure room where he reads it with Julia napping by his side. [...]

[Input] Masked character description: [MASK], the novel's protagonist, is staunchly against the Party. [MASK] finds unobtrusive methods to rebel, or at least [MASK] believes them to go unnoticed. [MASK] main desire is to remain human under inhuman circumstances.

Candidates: "Julia" | "Winston Smith" | "O'Brien"

Answer: "Winston Smith"



Character Description Generation

Given a literature summary, and a character name, the goal in this task is to analyze the summary from the character's perspective and generate a coherent character description.


[Input] Book summary: opens with the narrator, Jake Barnes, delivering a brief biographical sketch of his friend, Robert Cohn. Jake is a veteran of World War I who now works as a journalist in Paris. Cohn is also an American expatriate, although not a war veteran. He is a rich Jewish writer who lives in Paris with his forceful and controlling girlfriend, Frances Clyne. Cohn has become restless of late, and he comes to Jake's office one afternoon to try to convince Jake to go with him to South America. Jake refuses, and he takes pains to get rid of Cohn. That night at a dance club, Jake runs into Lady Brett Ashley, a divorced socialite and the love of Jake's life. Brett is a free-spirited and independent woman, but she can be very selfish at times. She and Jake met in England during World War I, when Brett treated Jake for a war wound. During Jake and Brett's conversation, it is subtly implied that Jake's injury rendered him impotent. Although Brett loves Jake, she hints that she is unwilling to give up sex, and that for this reason she will not commit to a relationship with him. The next morning, Jake and Cohn have lunch. Cohn is quite taken with Brett, and he gets angry when Jake tells him that Brett plans to marry Mike Campbell, a heavy-drinking Scottish war veteran. That afternoon, Brett stands Jake up. That night, however, [...]

[Input] Character name: Lady Brett Ashley

[Output] Character description: A beautiful British socialite who drinks heavily. As the novel begins, Brett is separated from her husband and awaiting a divorce. Though she loves Jake, she is unwilling to commit to a relationship with him because it will mean giving up sex. Indeed, she is unwilling to commit fully to any of the many men who become infatuated with her, though she has affairs with a number of them. However, she does not seem to draw much happiness from her independence. Her life, like the lives of many in her generation, is aimless and unfulfilling.


Citation

@inproceedings{brahman-etal-2021-characters-tell,
  Title="{``}Let Your Characters Tell Their Story{''}: A Dataset for Character-Centric Narrative Understanding"
  author={Brahman, Faeze and Huang, Meng and Tafjord, Oyvind and Zhao, Chao and Sachan, Mrinmaya and Chaturvedi, Snigdha},
  Booktitle = "Findings of the Association for Computational Linguistics: EMNLP 2021",
  Year = "2021",
}

Authors

Contact

  • fbrahman@ucsc.edu