Keyboard Shortcuts?f

×
  • Next step
  • Previous step
  • Skip this slide
  • Previous slide
  • mShow slide thumbnails
  • nShow notes
  • hShow handout latex source
  • NShow talk notes latex source

Click here and press the right key for the next slide.

(This may not work on mobile or ipad. You can try using chrome or firefox, but even that may fail. Sorry.)

also ...

Press the left key to go backwards (or swipe right)

Press n to toggle whether notes are shown (or add '?notes' to the url before the #)

Press m or double tap to slide thumbnails (menu)

Press ? at any time to show the keyboard shortcuts

 

A Problem for Minimal Theory of Mind

I

a problem for minimal theory of mind

How do agents ever perform optimally when time is pressing and cognitive resources such as working memory are scarce?

Minimal Models Programme—Mindreading

1. construct (or borrow) a model

2. test the model’s signature limits(but Kampis & Kovács (2022)?)

3. say when each model is used ???

Will not go over because details not important and already published a while ago but two things to note ...
In the model, mental states are relations to objects and their features, not representations of objects.
This makes things a lot simpler but also limits what you can do with the model.
The other thing is that we borrowed the model from a left behind theory of mind that everyone agreed had failed. I mention this because later in the talk I’m sharing an unfinished search for a minimal model and one of the key techniques is to womble—that is to re-cycle early, failed attempts to provide a theory of how things actually are in a domain.

Minimal Models Programme—Mindreading

1. construct (or borrow) a model

2. test the model’s signature limits(but Kampis & Kovács (2022)?)

3. say when each model is used ???

Minimal Models Programme—Mindreading

1. construct (or borrow) a model

2. test the model’s signature limits(but Kampis & Kovács (2022)?)

3. say when each model is used ???

[explain why pressing—a lot of the research finds signature limits of minimal theory of mind in proactive gaze and response times. This is encouraging. But theoretically we are not committed to the prediction that proactive gaze will always use a minimal model. On the contrary, since you can intentionally control your gaze (and to some extent also your reaction times), we expect there to be cases where minimal theory of mind does not influence proactive gaze or reaction times.]

a. automatic → minimal

Good first step was link with automaticity.
Not bad as far as it went, but automaticity is a very general feature and so doesn’t provide a lot of insight.
Also difficult in practice to test both whether automatic (change instructions and see if the effect persists) and signature limit (change from FB-location to FB-identity)

b. motor mindreading conjecture: minimal models of mind are implemented motorically

Let me start by explaining the background and motivation for this wild conjecture ...
[Could minimal models of mind also be tied to broadly perceptual procesess? In my view that is possible but could not be the whole story.]

Background

Kovács Effect (Kovács, Téglás, & Endress, 2010)

[Low, Edwards, & Butterfill (2020, p. figure 1, part) based on Kovács et al. (2010)]

Low et al. (2020, p. figure 1, part) based on Kovács et al. (2010)

Low et al. (2020, p. figure 1, part) based on Kovács et al. (2010)

First thing to say: it’s a ball detection task.

Low et al. (2020, p. figure 1, part) based on Kovács et al. (2010)

Low et al. (2020, p. figure 1, part) based on Kovács et al. (2010)

Low et al. (2020, p. figure 1, part) based on Kovács et al. (2010)

Low et al. (2020, p. figure 1, part) based on Kovács et al. (2010)

Low et al. (2020, p. figure 1, part) based on Kovács et al. (2010)

Question

Why do others’ false beliefs ever have an effect on your own actions?

Also---a second question---, if this *is* fast mindreading, what kinds of process underpin it? (We know something about broad architectural features and maybe even about minimal models of mind; but we don’t have much of a theory about the processes it involves yet.)
Inspiration: Action anticipation can influence reaction times.
NB: In this experiment, participants had to imitate a reach-to-grasp movement which was modelled for them before the go-stimulus (the mug) appeared.
WHat is measured? Movement initiation times. (NB not response times.)

Costantini et al, 2010 figure 1b

Anticipation associated with other people’s action possibilities can also influence your movement initiation times.

Costantini et al, 2011 figures 3,4

Why do others’ false beliefs ever have an effect on your own actions?

Outcomes such as reaching for and grasping of a cup can be represented motorically.
As a body of research on mirror neurons and motor simulation more generally demonstrates, motor representations of outcomes can generate expectations concerning another agent’s behaviour
These expectations are plausibly compared with the behavior that is actually observed.
And we conjecture that the result of this comparison modulates the strength of the motor representation of the outcome.
Within limits, this modulation will ensures that an outcome represented motorically is likely to be a goal of the observed action.
In this way, motor representations enable goal tracking.
So far we have nothing about belief-tracking. Where could that come in?
Jason’s pilot indicates that belief-tracking, which I suppose involves representing registrations, can influence behavioural expectations. But how?
In principle, we might imagine that the belief-tracking process results in a second, independent behavioural expectation.
While we cannot rule this possibility out, it seems to add theoretical complexity.
After all, belief-tracking depend so on goal-tracking in this way: you can only track another’s mental states by tracking their actions. We therefore need the goal-tracking process to provide input to the belief-tracking process.
But if the goal-tracking process ignores the belief-tracking process, then false beliefs would cause it to make systematic errors about the goals of actions. Since these errors would feed into the belief-tracking process, it would seem that this process too should go wrong whenever there is a false belief. But then there would be no point in tracking beliefs at all.
Our proposal is therefore different: the belief-tracking process influences the process by which the behavioural expectation is generated. The representation of registration means that behavioural expectation is generated as if things were as they are registered as being, rather than as they actually are. Put colourfully, another’s registration can change the world as seen by your motor system. (This might be why Katheryn has repeatedly found altercentric intereference effects of belief on motor actions.)
This picture has a radical implication about the nature of the automatic belief-tracking processes. It implies that those belief-tracking processes must interface directly with motor processes. This requires, in turn, that automatic belief-tracking represents objects and outcomes in the same format as the motor representations do. Motor processes and belief-tracking must share a common representational format.
Although lots of details are not specified by the picture, its is does make readily testable predictions. For one thing, it implies that limits on what can be represented motorically are also limits on automatic belief-tracking.

Prediction

The picture also generates a prediction that has been tested: where a goal-tracking response is underpinned by motor simulation, the goal-tracking will manifest sensitivity to the observed agent’s beliefs. If Jason’s preliminary findings hold up, they will provide evidence that the prediction is correct.
So far, the picture is neutral about the timing of the effect. In order to better understand the link between belief-tracking and goal-tracking, it would be helpful to have information about the timings of these processes. In particular, it would be good to know whether the observed agent’s beliefs influence goal-tracking from the earliest point at which it can be observed, or whether there is a period during which goal-tracking processes are unaffected by the agent’s beliefs. In making this kind of discovery possible, Jason’s paradigm should enable us to understand more about how belief-tracking processes are linked (or not) to goal-tracking processes.

In motor mindreading only, physically constraining protagonists (or participants) will impair belief tracking.

I will show you the good news first.

Low et al. (2020, p. figure 1, part) based on Kovács et al. (2010)

Low et al. (2020, p. figure 1, part) based on Kovács et al. (2010)

Low et al. (2020, p. figure 1, part) based on Kovács et al. (2010)

Low et al. (2020, p. figure 1, part) based on Kovács et al. (2010)

Low et al. (2020, p. figure 2)

Nice replication, which is mildly interesting because we used a movie clips with real people rather than smurfs.
The loose sheet control works great: same Kovacs effect.
Any trace of which is just gone with the mumified figure. Now response times are just a function of the participants’ own beliefs.

Low et al. (2020, p. figure 3)

Prediction

In motor mindreading only, physically constraining protagonists (or participants) will impair belief tracking.

What about constraining participants (rather than the agent)? Cannot constrain participants with the Kovacs-paradigm (because depends on RTs and might not work if you switched from manual responses). So Pieter Six, who is a just-finished PhD student supervised by Jason Low and myself adapted a different paradigm involving anticipatory looking ...

Six (2022, p. figure 11)

‘participants in the movement-restricted group were required to hold on to the elastic band at the start of every experimental block.’ (Six, 2022, p. 98)
[Six (2022, p. 95) Experiment 1: ‘predictive gaze behaviour was modulated by the false belief state of the agent’] So far, so good. [In Experiment 1, we had no response to the videos required but there was a visual detection task - press a key when one of the cups turns purple, which we expected would help to keep people attentive and ‘disguise the real purpose of the expeirment’.]
The basic finding that false belief states modulate predictive gaze behaviour was partially replicated in Experiment 2, (although differently from Experiment 1, ‘In the false belief condition, we saw that anticipatory looking times generally sat around chance level.’ but this could be due to some technical difficulties with the equipment?) [Ask Pieter: I think the attention check still involved a keypress, which the participant could do with the elastic band?]
However the motor mindreading prediction was not supported: ‘Our crucial manipulation in this experiment was the addition of a group that was motor-restricted and therefore unable to grasp for a cup, which should in principle attenuate motor simulation and action prediction. This, however, was not the case.’ (Six, 2022, p. 111)
[Also Six (2022, p. Experiment 3) did not find evidence that false belief states modulate predictive gaze behaviour. I think this may be because we asked participants to predict the action on each trial (‘Unlike previous experiments, this experiment featured a question prompt (“on which side of the screen will the hand appear?”) after each trial upon participants were asked to respond vocally with “left” or “right”.’) Notably, DLTS and explicit behavioural predictions were tightly correlated; this suggests to me that asking the question may have altered which processes moved the eyes.]

Prediction

In motor mindreading only, physically constraining protagonists (or participants) will impair belief tracking.

OK, let’s go back to constraining the agent’s action possibilities since we had more luck with that ...

Zani, Butterfill, & Low (2020)

What if we bind the protagonist?

‘The fact that the mediolateral difference between true belief condition and false belief condition disappears when manipulating the agent’s ability to move (i.e., TBT = FBT) is suggestive of an attenuation of participants’ ability to motorically represent the goal of the observed action. However, the lack of a significant effect within conditions (i.e., TBU = TBT; FBU = FBT) also indicates that the effect of constraint on the ability to generate motor predictions about observed belief based actions is not conclusive.’ (Zani PhD, forthcoming)
[On Experiment 2:] ‘In the true belief condition, we again saw a clear effect of hand preshaping on anticipatory looking times. In the false belief condition, we saw that anticipatory looking times generally sat around chance level. Although less clear-cut than results in the first experiment, this still entails that overall looking scores were not completely driven by hand preshaping, at least suggesting an impact of the opposing belief state of the agent.’ (Six, 2022, p. 111)
Sinigaglia, Quarona, Riva, & Butterfill (2021)
sourceparadigmmeasurewho bound?as predicted?
Low &c, 2020Kovacs’ SmurfRTagentY
Six, 2022 Exp. 2Six’ Cupslooking timeparticipantN
Zani, forthcoming Exp. 2Buttelmann/ helpingleaningagentsuggestive
Pascarelli, Sinigaglia et al in prepKovacs’ SmurfRTagentunknown

How do agents ever perform optimally when time is pressing and cognitive resources such as working memory are scarce?

Minimal Models Programme—Mindreading

1. construct (or borrow) a model

2. test the model’s signature limits(but Kampis & Kovács (2022)?)

3. say when each model is used ???

a. automatic → minimal

b. motor mindreading conjecture: minimal models of mind are implemented motorically