• Home
  • CLT seminar: John Kelleher - Modelling Attention within Multimodal Dialogue Contexts

CLT seminar: John Kelleher - Modelling Attention within Multimodal Dialogue Contexts

SEMINAR

The fundamental claim of this talk is that attention -- both visual and linguistic -- is an important overarching semantic category structuring visually situated dialogue. Based on this it is argued that computer systems attempting to model the evolving context of a visually situated dialogue should integrate models of visual and linguistic attention within their natural language processing framework. The talk will present a dialogue framework that integrates attention into the representations of the evoling context. Within this framework a model of perceptual attention underpins two of the core subtasks of NLP: reference resolution and the generation of referring expressions. There are three main components within the framework: a model of synthetic visual attention, a set of computational models of spatial term semantics, and a discourse model integrating visual and linguistic information.

John D. Kelleher Applied Intelligence Research Center, School of Computing, Dublin Institute of Technology

http://www.comp.dit.ie/jkelleher/

Date: 2014-12-11 10:30 - 12:00

Location: L308, Lennart Torstenssonsgatan 8

Permalink

add to Outlook/iCal

To the top

Page updated: 2014-12-08 09:19

Send as email
Print page
Show as pdf

X
Loading