Skip to content

Automatic and generic measures of verbal alignment in dyadic dialogue based on sequential pattern mining at the level of surface of text utterances

License

Notifications You must be signed in to change notification settings

GuillaumeDD/dialign

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

14 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

dialign

Latest version: 1.1 [download link]

Previous versions: 1.0

dialign is a software that provides automatic and generic measures of verbal alignment and self-repetitions in dyadic dialogue based on sequential pattern mining at the level of surface of text utterances.

A good place to start can be found in the following paper (more information can be found in the "Citing dialign" section):

  • Dubuisson Duplessis, G.; Langlet, C.; Clavel, C.; Landragin, F., Towards alignment strategies in human-agent interactions based on measures of lexical repetitions, Lang Resources & Evaluation, 2021, 36p. [HAL | DOI]

Table of content:

Framework

dialign is based on the observation that the behaviours of dialogue participants tend to converge and automatically align at several levels (such as the lexical, syntactic and semantic ones). One consequence of successful alignment at several levels between dialogue participants is a certain repetitiveness in dialogue leading to the development of a lexicon of fixed expressions. As a matter of fact, dialogue participants tend to automatically establish and use fixed expressions that become dialogue routines. More concretely, here follows an excerpt of a dialogue between a human and an agent operated by a Woz where instances of shared lexical patterns are coloured (from the journal article):

Excerpt of a dialogue between a human and an agent where instances of shared expressions are coloured.

dialign provides a framework to quantify the interactive lexical alignment process and the self-repetition behaviour of dialogue participants (DPs) in dyadic textual dialogues. This framework focuses on lexical patterns occurring in dialogue utterances. It distinguishes two main types of such patterns. The first type is shared lexical patterns between DPs, i.e., patterns that are initiated (or primed) by a DP, subsequently adopted by the other DP and possibly reused during the dialogue by any DP. These patterns are directly related to the interactive verbal alignment process, a particular type of on-the-fly linguistic adaptation. They can be seen as shared dialogue routines at the lexical level. They are a way to verbally align and ultimately share a common language to improve understanding, collaboration and social connection to a conversational partner. The second type is lexical self-repetition. Contrary to the previous type which considers patterns that are shared between DPs, self-repetition considers each DP in isolation. Self-repetitions are lexical patterns appearing at least twice in the dialogue utterances of a given DP, independently of the other DP's utterances. Self-repetitions are directly related to the self-consistency of the linguistic production of a given DP.

Idea of the framework: automatic building of the shared expression lexicon to derive verbal alignment measures

The main concept behind this model is the automatically built lexicon. For each dialogue transcript, three lexicons are automatically computed:

Lexicons and the dialogue transcript are leveraged by deriving offline and online measures to quantify aspects of the verbal alignment process and the self-repetition behaviour of DPs. Offline measures are intended to be used for past dialogue interactions (e.g., corpus studies) while online measures are intended for use in a dialogue system.

dialign currently provides out-of-the box offline measures for corpus studies. Online usage in a dialogue system is available as a demonstration.

Measures Provided by dialign

dialign provides a set of measures to characterise both:

  1. the interactive verbal alignment process between dialogue participants, and
  2. the self-repetition behaviour of each participant.

These measures allow the characterisation of the nature of these processes by addressing various informative aspects such as their variety, strength, complexity, stability, and orientation. In a nutshell:

  • variety: the variety of shared expressions or self-repetitions emerging during a dialogue relative to its length. It is directly related to the number of unique expressions in a lexicon.
  • strength: the strength of repetition of the (shared) lexical patterns, i.e., how much the patterns are reused.
  • complexity: the complexity indicates the variety of the types of lexical patterns. It is here featured by Shannon entropy measures. High entropy indicates the presence of a wide range of lexical patterns relative to their lengths in number of tokens (e.g., ranging from a single word to a full sentence). On the contrary, low entropy indicates the predominance of one type of lexical pattern.
  • extension and stability: The extension and stability of the (shared) lexical patterns are related to the size of the lexical patterns. The extension indicates the size of the lexical patterns. The longer it is, the more extended the lexical pattern is. Extension is directly linked to the stability of the processes since the more extended the patterns are, the more stable the processes are.
  • orientation: the orientation of the interactive alignment process, i.e., it indicates either a symmetry (both dialogue participants initiate and reuse the same number of shared lexical patterns), or an asymmetry (a dialogue participant initiates and/or reuses more shared lexical patterns).

Measures Characterising the Interactive Verbal Alignment Process

Speaker-independent

Measure Description Aspects
EV Expression Variety (EV). The shared expression lexicon size normalized by the length of the dialogue (which is its total number of tokens in the dialogue). Variety
ER Expression Repetition (ER). The proportion of tokens which DPs dedicate to the repetition of a shared expression. Strength
ENTR Shannon entropy of the lengths in token of the shared expression instances. Complexity
L Average length in token of the shared expression instances. Stability
LMAX Maximum length in token of the shared expression instances. Stability

Speaker-dependent

Measure Description Aspects
IE_S Initiated Expression (IE) for locutor S. Ratio of shared expressions initiated by locutor S. Orientation
ER_S Expression Repetition (ER) for locutor S. Ratio of tokens produced by S belonging to an instance of a shared expression. Strength

Measures Characterising Self-Repetition Behaviour of each Dialogue Participant

Measure Description Aspects
SEV_S Self-Expression Variety (SEV) for locutor S. For locutor S, the self-repetition lexicon size normalized by the total number of tokens produced by S in the dialogue. Variety
SER_S Self-Expression Repetition (SER) for locutor S. The proportion of tokens which locutor S dedicates to self-repetition. Strength
SENTR_S Shannon entropy of the length in token of the self-repetitions from S. Complexity
SL_S Average length in tokens of the self-repetitions from S. Stability
SLMAX_S Maximum length in token of the self-repetitions from S. Stability

Synthetic Presentation of the Provided Measures

Aspect Speaker-independent Measures (*) Speaker-dependent Measures (**)
Variety EV SEV_S
Strength ER ER_S, SER_S
Complexity ENTR SENTR_S
Stability L, LMAX SL_S, SLMAX_S
Orientation -- IE_S

(*) All these measures are related to the interactive verbal alignment process

(**) Measures starting with 'S' are related to the self-repetition behaviour, the others are related to the interactivate verbal alignment process

Installation

From JAR (preferred way)

A ready-to-use JAR is available on github. Check the latest release!

From source code (for developers)

You can generate the JAR from SBT.

First, clone the repository. Then, you can compile the code:

$ sbt compile

Eventually, you can produce the JAR as follows (requires sbt-assembly):

$ sbt assembly

The JAR file can be probably found in the directory dialign/target/scala-2.13/.

Usage

dialign is designed to be easy to use from the command line interface.

dialign for Corpus Studies

dialign provides out-of-the box offline measures for corpus studies.

Tutorial

A complete walkthrough tutorial is available in the examples/dialign-offline/ directory.

In this tutorial, you will:

CLI Usage Example

Let's say that the dialogue files are in the input directory input-directory/ and that output is planned in the directory output-directory/. To run dialign with this configuration, proceed as follows:

java -jar dialign.jar -i input-directory/ -o output-directory/

(here we assume that the dialogue files are encoded in UTF-8, if not it is possible to specify a different encoding by adding -Dfile.encoding=ISO-8859-1 where ISO-8859-1 is the desired encoding)

dialign allows to filter input dialogue files by prefix, suffix and extension. For instance, if the only input dialogue files to consider are files matching the following pattern: dialogue-*-cleaned.dial, it is possible use the following options with dialign:

java -jar dialign.jar -i input-directory/ -o output-directory/ \
	-p "dialogue-" \ # specification of a required filename prefix
	-s "-cleaned" \ # specification of a required filename suffix
	-e "tsv" # specification of the extension (without the '.')

More options are available, see usage note:

java -jar dialign.jar -h

dialign-online for Interactive Purposes

This framework can also be embedded in an interactive system. To demonstrate these capabilities, a complete tutorial is available in the examples/dialign-online/ directory.

In this tutorial, you will:

A screenshot of this demonstration can be found below:

Demonstration of dialign-online

Contributors

  • Guillaume Dubuisson Duplessis (2017, 2020, 2021, 2022)

Citing dialign

If you want to refer to the framework or to the dialign software, please cite the following paper:

  • Dubuisson Duplessis, G.; Langlet, C.; Clavel, C.; Landragin, F., Towards alignment strategies in human-agent interactions based on measures of lexical repetitions, Lang Resources & Evaluation, 2021, 36p. [HAL | DOI]

If you want to refer to the study strictly limited to verbal alignment on a Human-Agent negotiation task, please cite this paper :

  • Dubuisson Duplessis, G.; Clavel, C.; Landragin, F., Automatic Measures to Characterise Verbal Alignment in Human-Agent Interaction, 18th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL), 2017, pp. 71--81 [See paper | BIB]

Contact

The authors of this work would be happy to hear about you if you are using this code! Please, do not hesitate to contact us:

License

CECILL-B - see the LICENSE file.

About

Automatic and generic measures of verbal alignment in dyadic dialogue based on sequential pattern mining at the level of surface of text utterances

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages