Keyboard Shortcuts?f

×
  • →Next step
  • ←Previous step
  • ↓Skip this slide
  • ↑Previous slide
  • mShow slide thumbnails
  • tShow transcript (+SHIFT = all transcript)
  • nShow notes (+SHIFT = all notes)

Please be cautious in using the transcripts.

They were created mechanically and have mostly not been checked or revised.

Here is how they were created:

  1. live lecture recorded;
  2. machine transcription of live recording;
  3. ask LLM to clean up transcript, and link to individual slides.

This is an error-prone process.

Click here and press the right key for the next slide.

(This may not work on mobile or ipad. You can try using chrome or firefox, but even that may fail. Sorry.)

also ...

Press the left key to go backwards (or swipe right)

Press n to toggle whether notes are shown (or add '?notes' to the url before the #)

Press m or double tap to slide thumbnails (menu)

Press ? at any time to show the keyboard shortcuts

 

Intro

INTERFACES

---

[email protected]

[email protected]

tinyurl.com/5cc64hjk

The broken escalatorA person walks towards a stationary escalator in three steps. On the second step the thought “It’s stopped.” appears. On the third he steps onto the first step with an exaggerated forward lean. A stopped-escalator sign marks the cause. A tiny black-hat observer on the landing is a tribute to xkcd. Dashed arrows are optional movement expectations, not actual escalator motion.It’s stopped.It’s stopped.It’s stopped.ESCALATORSTOPPED?

based on Reynolds & Bronstein (2003)

intention and knowledge sometimes fail to match what is represented motorically

intention and knowledge are not inferentially integrated with motor representation

‘to account for the connection between
prior intentions and
intentions in action ,

it is necessary to explain

[1] how a subject can possess action concepts and

[2] how, when a prior intention causes an intention in action, the conceptual content of the prior intention can be converted into the non-conceptual content of an intention in action.’

(Pacherie, 2000, p. 423)

Interface Problem

two kinds of representation have contents that can match (or not); and

those representations are not inferentially integrated; but

the representations sometimes non-accidentally match.

How is the non-accidental matching possible?

two kinds of state are inferentially integrated:

in the absence of obstacles
such as time pressure, distraction, motivations to be irrational, self-deception or exhaustion,

any states of these kinds can jointly feature in a single process
of inference or practical reasoning

in such a way that
arbitrary rational relations between their contents
appropriately influence how the process unfolds.

two responses

it’s not a real problem

it’s real but your solution is wrong

interface problemS

primary motivational states vs desires
(Dickinson & Balleine, 1994)

precise number representations vs analog magnitudes
(Odic, Le Corre, & Halberda, 2015; Ebersbach & Erz, 2014)

ant navigation: path integration vs visual landmarks
(Buehlmann, Mangan, & Graham, 2020)

owls: auditory vs visual cues to location
(Knudsen, 2002)

...

interface problems with artifacts

flight controllers: radar vs flight strips
(Durso, Batsakes, Crutchfield, Braden, & Manning, 2004)

astronomy: radio vs optical measurements
(Fan, Budavári, Norris, & Basu, 2020)

music: sheet vs audio
(Dannenberg & Raphael, 2006)

...

Why are interface problems pervasive? Why not just inferentially integrate?

costs of inferential integration:

- design complexity [long term]

- greater risk of error [immediate]

‘Often the performance of a data fusion system [...] is below that of the individual sensors. This phenomena is known as catastrophic fusion’

(Mitchell, 2026, p. 11).

aside: representational format

 

the interface problem ‘is framed by [...] assumptions [including] that intentions are propositionally formatted, whereas motor representations are not

[...]

this understanding of the interface may need replacement. Arguably there are several interfaces within motor representation (and indeed, cognition)’

(Mylopoulos, Pacherie, & Shepherd, 2025, p. §7)

two responses

it’s not a real problem

it’s real but your solution is wrong

Reference by deferenceA deferential action concept may be acquired through experiences of acting or imagining acting that depend on motor representation. The concept refers to an action outcome by deferring to motor representation and can later figure in intentions. The final red dashed line, a critical extension rather than a claim of the original proposal, asks whether fixing the concept's reference explains non-accidental matching on each occasion of use.intentionmotor representationtranslation?action outcomegrasping / releasingthe mug’s handlerepresentsexperience of acting /imagining actingshapes experiencedeferentialaction conceptenables acquisitiondeferencerefers tolater usematching !?!

objections to reference by deference

misfire

‘unclear what it would be for such a demonstrative to misfire, i.e., to “point” to the wrong motor representation’.

selection

‘the agent must have an independent grasp of which motor representation is the appropriate one to select via such deferral. But this would require a way of translating between the intention and the motor representation’.

awareness

motor representations ‘are subpersonal states that are inaccessible to awareness’

Mylopoulos & Pacherie (2016, p. §4)

ooof!

simple objection

fixing reference demonstratively does not explain matching

Reference by deferenceA deferential action concept may be acquired through experiences of acting or imagining acting that depend on motor representation. The concept refers to an action outcome by deferring to motor representation and can later figure in intentions. The final red dashed line, a critical extension rather than a claim of the original proposal, asks whether fixing the concept's reference explains non-accidental matching on each occasion of use.intentionmotor representationtranslation?action outcomegrasping / releasingthe mug’s handlerepresentsexperience of acting /imagining actingshapes experiencedeferentialaction conceptenables acquisitiondeferencerefers tolater usematching !?!

observational vs executable action concept
(Pacherie, 2011, p. §3)

executable action concepts are linked to motor schemas
(Mylopoulos & Pacherie, 2016, p. §5)

deployment of an executable action concept ‘serves as a pointer to a specific location in LTM, where appropriate motor schemas ... are stored’
(Mylopoulos, 2022, p. 288)

compare: concepts are pointers
(Shea, 2024)

structured action representations
(Pacherie & Mylopoulos, 2021, p. §§4–6)

objections: Shepherd (2019); Levy (2025, p. §2.3); Ferretti & Caiani (2019, p. §3)

back to 2000 ...

‘basic action concepts are demonstrative concepts.

To have the concept of a basic action is to have a concept of acting ‘thus’,

where ‘thus’ denotes a property made accessible to the agent by the motor representations he is able to form.’

(Pacherie, 2000, p. 425)

case study

Humans can

intentionally produce words

years before they can

act on phone-structured intentions successfully.

ex: add [p] to [ˈɔzɐ]
(Morais, Cary, Alegria, & Bertelson, 1979)

1–4mosearly catgeorical perception
(Eimas, Siqueland, Jusczyk, & Vigorito, 1971)
~5mosadjust vocalization toward vowel
(Kuhl & Meltzoff, 1996)
6mosrestricting relevant articulators impairs consonant discrimination
(Bruderer, Danielson, Kandhadai, & Werker, 2015; Choi, Bruderer, & Werker, 2019)
7–9mosbabbling *ba*, *da*, ...
(Kuhl & Meltzoff, 1996)
~36moswords, sentences, conversations
~4yrsrhyming games, limited phonological awareness
(Carroll, Snowling, Hulme, & Stevenson, 2003)
~5yrssegment into syllables
(Liberman et al., 1974)
by ~7yrsblend and segment phones
(Chafouleas, Lewandowski, Smith, & Blachman, 1997)
onset mathcing (day → dark or park?)
(Cheung, Chen, Lai, Wong, & Hills, 2001)
phone deletion (e.g. *rice* minus /r/ = *ice*)
(Høien, Lundberg, Stanovich, & Bjaalid, 1995)
phone substitution (/g/ → /n/ in *go* = *no*)
(Carroll et al., 2003; Chafouleas et al., 1997)

Two Interface Problems

from ~10-16 months on

belief/intention: word

matches (or not)

motor representation: word- or syllable-sized plan for articulatory gestures

after phonological awareness (≥5 years*)

belief/intention: phone-structured action

matches (or not)

motor representation: phone-sized components of plan for articulatory gestures

background

adaptation at phoneme level
(peturbed auditory feedback for /e/)
-> have phone-structured motor representations

but

little or no phonological awareness

in 4-5 year old pre-schoolers

(Caudrelier et al., 2019)

‘in NW [non-words] trials, the experimenter uttered a non-word which would become another non-word, for instance "osa" became "posa", "chosa" or "mosa" depending on phone condition.’

(Morais et al., 1979, p. 326)

(A. M. Liberman, Cooper, Shankweiler, & Studdert-Kennedy, 1967, p. fig.~2)

no acoustic criterion for dividing the sound into phones

‘the segmentation of the acoustic signal does not correspond directly or in any easily determined way to the segmentation at the phonemic level.

[...]

In bat, for example, the initial and final consonants are, in the conversion to sound, folded into the medial vowel, with the result that information about successive segments is transmitted more or less simultaneously on the same parts of the sound’

(I. Y. Liberman et al., 1974, p. 203)

articulatory getsure

example: closing the lips; constrict tongue tip

Goldstein & Fowler (2003, p. fig.~1)

lack of inferential integration
between motor representations and beliefs

most teachers cannot count the phones in ‘ox’
(Treiman & Cassar, 1997)

UK: [ɒ], [k], [s]

US: [ɑ], [k], [s]

btw: marks a limit of ‘mixed-format’ and ‘same-format’ views?

(Shepherd, 2019; Ferretti & Caiani, 2019)

One interface problem or two?

interface problem

Two Interface Problems

from ~10-16 months on

belief/intention: word

matches (or not)

motor representation: word- or syllable-sized plan for articulatory gestures

after phonological awareness (≥5 years*)

belief/intention: phone-structured action

matches (or not)

motor representation: phone-sized components of plan for articulatory gestures

crude idea 1

merely linking motor representations to perceived phonetic contrasts is sufficient for matching

motivation: Krieger-Redwood, Gaskell, Lindsay, & Jefferies (2013)

---

objection

Some adults never acquire phonological awareness
(Morais et al., 1979)

But motor representations of articulatory gestures can influence perception of phonetic contrasts ... even in pre-literate people
(D’Ausilio et al., 2009; Smalle, Rogers, & Möttönen, 2015; Carneiro Pereira, Patri, & Vannuscorps, 2026)

(Choi et al., 2019, p. fig.~1)

(Bruderer et al., 2015, p. fig.~5)

crude idea 1

merely linking motor representations to perceived phonetic contrasts is sufficient for matching

motivation: Krieger-Redwood, Gaskell, Lindsay, & Jefferies (2013)

---

objection

Some adults never acquire phonological awareness
(Morais et al., 1979)

But motor representations of articulatory gestures can influence perception of phonetic contrasts ... even in pre-literate people
(D’Ausilio et al., 2009; Smalle, Rogers, & Möttönen, 2015; Carneiro Pereira, Patri, & Vannuscorps, 2026)

crude idea 2

linking letters to phones is what enables matching

motivation: Morais et al. (1979); Read et al. (1986)

---

objection

‘some individuals can learn to do this task without alphabetic literacy.’
(Read et al., 1986, p. 39) [actually just one iirc, but still]

‘Czech and English children reliably isolated phonemes for which they did not know the corresponding letter’
(Hulme et al., 2005, p. B1)

Castiglioni-Spalten & Ehri (2003, p. fig.~1)

so far:

phone-structured motor representations not sufficient but can facilitate performance in phonological tasks

alphabetic literacy not necessary, but does predict ability

‘basic action concepts are demonstrative concepts.

To have the concept of a basic action is to have a concept of acting ‘thus’,

where ‘thus’ denotes a property made accessible to the agent by the motor representations he is able to form.’

(Pacherie, 2000, p. 425)

In the case of speech, what do motor representations make accessible?

sounds ≠ phonetic features (nor articulatory gestures)

‘the experimental task simply required our subjects to manipulate different sounds without regard for meaning.’

(Morais et al., 1979, p. 323 footnote 1)

participants ‘were asked to repeat it without the initial sound.’

(Chafouleas et al., 1997, p. 340)

‘I am going to say a word and I want you to tell me just the FIRST sound of that word.’

(Hulme et al., 2005)

‘while omitting its first, second, penultimate, or last sound.’

(Veenendaal, Groen, & Verhoeven, 2016, p. 58)

How do researchers themselves describe
phonological awareness?

‘Phonological awareness refers to one’s degree of sensitivity to the sound structure of oral language.’

‘phonemes do not have physical reality independent of each other. That is, phonemes produced in speech are acoustically inseparable because adjacent phonemes are coarticulated.’

(Anthony & Francis, 2005)

(Anthony & Francis, 2005)

‘the segmentation of the acoustic signal does not correspond directly or in any easily determined way to the segmentation at the phonemic level ...

There is ... no acoustic criterion by which one can segment the sound into its constituent phonemes.’

(I. Y. Liberman et al., 1974, pp. 203–4)

so far:

motor representations not necesary but can facilitate performance in phonological tasks

alphabetic literacy not necessary but does predict phonological awareness

‘basic action concepts are demonstrative concepts.

To have the concept of a basic action is to have a concept of acting ‘thus’,

where ‘thus’ denotes a property made accessible to the agent by the motor representations he is able to form.’

(Pacherie, 2000, p. 425)

inspiration : tones and keypresses

learn keypress-tone association ;
later: hearing tone influences which key is pressed

‘one does not need to anticipate all effects of an action to recruit the corresponding movement.’

(Elsner & Hommel, 2001, p. 230)

clue: literacy and motor performance are correlated:

better reading is linked to less coarticulation

(Popescu & Noiray, 2022; Cychosz, Munson, & Edwards, 2021; Cychosz, Munson, Newman, & Edwards, 2021)

rough proposal

Phone-related motor representations influence experience in such a way as to provide markers that reliably discriminate the outcomes of those motor representations.

These markers are difficult to selectively attend to.

Learning letters can assist because some (not all) of the motor structure corresponds to that implied by letters
(or: is made to correspond through becoming literate).

Once you can attend to the markers, you can acquire (executable action) concepts that specify the markers (‘thus’).

Experience-backed demonstrative conceptsAn indirect proposed route to matching: phone-related motor representations influence experience, which yields discriminating markers. Attending to markers, sometimes aided by letters or mouth pictures, enables acquisition of demonstrative concepts later used in intentions. A red break indicates failure of inferential integration; a dashed white arrow indicates possible feedback from literacy to motor structure. This explains matching, not motor-plan selection.intentionphone-related motorrepresentationsinfluencesexperienceyieldsmarkers discriminatemotor outcomesattend tomarkersletters / mouth pictureshelpdemonstrativeconceptlater useexecutable actionconcept link

Misfire Objection

‘unclear what it would be for such a demonstrative to misfire’

Mylopoulos & Pacherie (2016, p. §4)

reply: those who say ‘ox’ has two phones, [ɒ] and [ks], are deferring to a letter falsely believing that they are demonstrating a single phone.

Selection Objection

Lack of Example Objection

Awareness Objection

CONCLUSION

Some Interface Problems are genuine problems;
we do not yet know how to solve them all—

but expeirence and demonstrative action concepts
are likely to matter.

appendix

INTENTIONyesno
Is it a mental state?Davidson (1978)Thompson (2008)
Is it a belief?Velleman (1989)Bratman (1987)
Entails belief?Harman (1976)Levy (2018)
Linked to planning?(Bratman, 1985)
Incompatible with habitual? Kalis & Ometto (2021)
Entails non-observational knowledgeAnscombe (1957)
Comes in two kinds?Searle (1983)Brozzo (2021)