Keyboard Shortcuts?f

×
  • Next step
  • Previous step
  • Skip this slide
  • Previous slide
  • mShow slide thumbnails
  • nShow notes
  • hShow handout latex source
  • NShow talk notes latex source

Click here and press the right key for the next slide.

(This may not work on mobile or ipad. You can try using chrome or firefox, but even that may fail. Sorry.)

also ...

Press the left key to go backwards (or swipe right)

Press n to toggle whether notes are shown (or add '?notes' to the url before the #)

Press m or double tap to slide thumbnails (menu)

Press ? at any time to show the keyboard shortcuts

 

Object Indexes

4- to 6-month-olds can track briefly occluded objects

scenariomethodsource
1 vs 2 objects habituationSpelke et al 1995
one unperceived object constrains another’s movementhabituationBaillargeon 1987
where did I hide it?violation-of-expectationsWilcox et al 1996
wide objects can’t disappear behind a narrow occluderviolation-of-expectationsWang et al 2004
when and where will it reappear?anticipatory lookingRosander et al 2004
marker of object maintenancEEGKaufman et al 2005

How?

So theories of core knowledge do not seem to be equipped to explain existing patterns in infants’ successes and failures in tracking briefly occluded objects. Nor do they generate new predictions. Let us therefore put them to one side for the moment.
If it isn’t a matter of knowledge, and if it can’t be explained by appeal to core knowledge, then how do four- and five-month-olds track briefly occluded objects?

object indexes

In adult humans, there is a system of object indexes which enables them to track potentially moving objects in ongoing actions such as visually tracking or reaching for objects, and which influences how their attention is allocated (Flombaum, Scholl, & Pylyshyn, 2008).
But what is an object index? Formally, an object index is ‘a mental token that functions as a pointer to an object’ (Leslie, Xu, Tremoulet, & Scholl, 1998, p. \ 11). If you imagine using your fingers to track moving objects, an object index is the mental counterpart of a finger (Pylyshyn, 1989, p. 68).
Leslie et al say an object index is ‘a mental token that functions as a pointer to an object’ (Leslie et al., 1998, p. \ 11)
‘Pylyshyn’s FINST model: you have four or five indexes which can be attached to objects; it’s a bit like having your fingers on an object: you might not know anything about the object, but you can say where it is relative to the other objects you’re fingering. (ms. 19-20)’ (Scholl & Leslie, 1999)
A key experimental tool used to investigate the existence of, and the principles underpinning, a system of object indexes is the Object Specific Preview Benefit.
Object indexes ... \begin{itemize} \item guide ongoing action (e.g.~visual tracking, reaching) \item influence how attention is allocated (Flombaum et al., 2008) \item can be assigned in ways incompatible with beliefs and knowledge (Mitroff, Scholl, & Wynn, 2005; Mitroff & Alvarez, 2007) \item have behavioural and neural markers, in adults and infants (Richardson & Kirkham, 2004; Kaufman, Csibra, & Johnson, 2005). \item are subject to signature limits (Carey, 2009, pp. 83--87) \item sometimes survive occlusion (Flombaum & Scholl, 2006) \end{itemize}
The interesting thing about object indexes is that a system of object indexes (at least one, maybe more) appears to underpin cognitive processes which are not strictly perceptual but also do not involve beliefs or knowledge states. While I can’t fully explain the evidence for this claim here, I do want to mention the one basic experimental tool that is used to investigate the existence of, and the principles underpinning, a system of object indexes which operates between perception and thought ...
Suppose you are shown a display involving eight stationary circles, like this one.
 
Four of these circles flash, indicating that you should track these circles.
All eight circles now begin to move around rapidly, and keep moving unpredictably for some time.
Then they stop and one of the circles flashes. Your task is to say whether the flashing circle is one you were supposed to track. Adults are good at this task (Pylyshyn & Storm, 1988), indicating that they can use at least four object indexes simultaneously.
(\emph{Aside.} That this experiment provides evidence for the existence of a system of object indexes has been challenged. See Scholl (2009, p. \ 59): \begin{quote} `I suggest that what Pylyshyn’s (2004) experiments show is exactly what they intuitively seem to show: We can keep track of the targets in MOT, but not which one is which. [...] all of this seems easily explained [...] by the view that MOT is simply realized by split object-based attention to the MOT targets as a set.' \end{quote} It is surely right that the existence of MOT does not, all by itself, provide support for the existence of a system of object indexes. However, contra what Scholl seems to be suggesting here, the MOT paradigm can be adapated to provide such evidence. Thus, for instance, Horowitz & Cohen (2010) show that, in a MOT paradigm, observers can report the direction of one or two targets without advance knowledge of which targets' directions they will be asked to report.)

Pylyshyn 2001, figure 6

In what follows I will take it for granted that, in adult humans, there is a system of object indexes which enables them to track potentially moving objects in ongoing actions such as visually tracking or reaching for objects, and which influences how their attention is allocated (Flombaum et al., 2008).

object indexes / files in adults and infants ...

  • guide ongoing action (e.g. visual tracking, reaching)
  • influence how attention is allocated
  • can conflict with beliefs and knowledge states
  • This system of object indexes does not involve belief or knowledge and may assign indexes to objects in ways that are inconsistent with a subject’s beliefs about the identities of objects (Mitroff et al., 2005; Mitroff & Alvarez, 2007)
  • have behavioural and neural markers
  • We have observed one behavioural marker of object indexes, namely the object-specific preview benefit.
    There are also neural markers of object indexes. That is, in adults there is a pattern of brain activity which appears to be characteristic of processes involved in maintaining an object index for an object that is briefly hidden from view.
  • are subject to signature limits
  • The system of object indexes is also subject to signature limits. In general, a \emph{signature limit of a system} is a pattern of behaviour the system exhibits which is both defective given what the system is for and peculiar to that system.
    One signature limit of a system of object indexes is that featural information sometimes fails to influence how objects are assigned in ways that seem quite dramatic. Let me illustrate ...
    In this scenario, a patterned square disappears behind the barrier; later a plain black ring emerges. If you consider speed and direction only, these movements are consistent with there being just one object. But given the distinct shapes and textures of these things, it seems all but certain that there must be two objects. Yet in many cases these two objects will be assigned the same object index (Flombaum & Scholl, 2006; Mitroff & Alvarez, 2007). So one signature limit of systems of object indexes is that information about speed and distance can override information about shape and texture.
  • sometimes survive occlusion
  • As the findings I just describes imply, object indexes can survive brief occlusion. That is, an object index can remain attached to an object even if that object is briefly occluded by a screen. (Sameness of object index may be detected by the presence of an object-specific preview benefit).
    To clarify terminology, I should say that whereas I’m talking about object indexes, researchers more typically interpret this research in terms of object files. I’m sticking to object indexes rather than object files for reasons of simplicity and caution. If you believe in object files then you can interpret what I’m saying as referring to object files. And if you have doubts about object files, you might still have reason to accept that a system of object indexes exists.
    So far I have been talking about object indexes in adult humans.
    But our interest in object indexes stems from a hypothesis about four-month-old infants’ abilities to track briefly occluded objects. According to this hypothesis, these abilities depend on a system of object indexes like that which underpins multiple object tracking or object-specific preview benefits (Leslie et al., 1998; Scholl & Leslie, 1999; Carey & Xu, 2001; Scholl, 2007). What makes this hypothesis attractive?
    One reason the hypothesis seems like a good bet is that object indexes are the kind of thing which could in principle explain infants’ abilities to track unperceived objects because object indexes can, within limits, survive occlusion.
    If we consider six-month-olds, we can also find behavioural markers of object indexes in infants (Richardson & Kirkham, 2004) ...
    ... and there are is also a report of neural markers too (Kaufman et al., 2005).
    (Kaufman et al. (2005) measured brain activity in six-month-olds infants as they observed a display typical of an object disappearing behind a barrier. They found the pattern of brain activity characteristic of maintaining an object index. This suggests that in infants, as in adults, object indexes can attach to objects that are briefly unperceived.)
    The evidence we have so far gets us as far as saying, in effect, that someone capable of committing a murder was in the right place at the right time. Can we go beyond such circumstantial evidence?
    The key to doing this is to exploit signature limits. Carey (2009) argues that what I am calling the signature limits of object indexes in adults are related to signature limits on infants’ abilities to track briefly occluded objects.
    To illustrate, a moment ago I mentioned that one signature limit of object indexes is that featural information sometimes fails to influence how objects are assigned in ways that seem quite dramatic.
    There is evidence that, similarly, even 10-month-olds will sometimes ignore featural information in tracking occluded objects (Xu & Carey, 1996).% \footnote{ This argument is complicated by evidence that infants around 10 months of age do not always fail to use featural information appropriately in representing objects as persisting (Wilcox & Chapa, 2002). In fact McCurry, Wilcox, & Woods (2009) report evidence that even five-month-olds can make use of featural information in representing objects as persisting (Wilcox, 1999, p. see also). %they use a fringe and a reaching paradigm. NB the reaching is a problem for the simple interpretation of looking vs reaching! Likewise, object indexes are not always updated in ways that amount to ignoring featural information (Hollingworth & Franconeri, 2009; C. M. Moore, Stephens, & Hein, 2010). It remains to be seen whether there is really an exact match between the signature limit on object indexes and the signature limit on four-month-olds’ abilities to represent objects as persisting. The hypothesis under consideration---that infants’ abilities to track briefly occluded objects depend on a system of object indexes like that which underpins multiple object tracking or object-specific preview benefits---is a bet on the match being exact. }
    Here are the results. The central column shows that infants looked longer when they saw two objects at test rather than when they saw a single object. This is not different from how they performed in a base line condition when the information about number was not present. And it is different from how they performed in the ‘spatiotemporal condition’ in which the two objects were at simultaneously visible at one point before the test phase.
    While I wouldn’t want to suggest that the evidence on siganture limits is decisive, I think it does motivate considering the hypothesis and its consequences. In what follows I will assume the hypothesis is true: infants’ abilities to track briefly occluded objects depend on a system of object indexes.
    The hypothesis has an advantage which I don’t think is widely recognised. This is that object indexes are independent of beliefs and knowledge states. Having an object index pointing to a location is not the same thing as believing that an object is there. And nor is having an object index pointing to a series of locations over time is the same thing as believing or knowing that these locations are points on the path of a single object. Further, the assignments of object indexes do not invariably give rise to beliefs and need not match your beliefs.
    To emphasise this point, consider once more this scenario in which a patterned square disappears behind the barrier; later a plain black ring emerges. You probably don't believe that they are the same object, but they probably do get assigned the same object index. Your beliefs and assignments of object indexes are inconsistent in this sense: the world cannot be such that both are correct.
    To illustrate, consider an ingenious experiment by Shinskey & Munakata (2001). There was an opaque screen that could rotate between lying flat on the ground and being raised to conceal a toy behind it. Shinskey and Munakata also used a second piece of apparatus just like the first except that the screen was transparent rather than opaque. They reasoned that infants would quite often pull the screen forwards just for fun, regardless of what is behind it. However, they also guessed that when infants know there is an interesting toy behind the screen, then they will pull it forwards more often than when they know that there is nothing behind the screen. This is just what happened when infants were presented with the apparatus involving a transparent screen: they sometimes pulled the screen forwards when there was no toy behind it, but they pulled it forwards significantly more often when the toy was behind it. What happened when infants were presented with the opaque screen? Here infants pulled the screen forwards no more often when they had observed a toy being placed behind it then when they had observed that there was nothing behind it. This is evidence that seven-month-old infants do not know that a toy they have very recently seen hidden behind a screen is behind the screen. After all, since knowledge guides action we would expect infants who know that a toy is behind an opaque screen to pull the screen forward more often than infants who know there is nothing behind the screen, just as they do when the screen is transparent.
    More than two decades of research strongly supports the view that infants fail to search for objects hidden behind barriers or screens until around eight months of age (Meltzoff & Moore, 1998, p. \ 202) or maybe even later (M. K. Moore & Meltzoff, 2008). Researchers have carefully controlled for the possibility that infants’ failures to search are due to extraneous demands on memory or the control of action. We must therefore conclude, I think, that four- and five-month-old infants do not have beliefs about the locations of briefly occluded objects. It is the absence of belief that explains their failures to search.

Scholl 2007, figure 4

Carey and Xu 2001, figure 3

Xu and Carey 1996, figure 4

Shinskey & Munakata 2001, figure 1

occlusionendarkening
violation-of-expectations+-
manual search-+

Charles & Rivera (2009)

What can object indexes explain?

Wynn 1992, fig 1 (part)

\emph{The CLSTX conjecture} Five-month-olds’ abilities to track occluded objects are not grounded on belief or knowledge: instead they are consequences of the operations of object indexes. \citep{Leslie:1998zk,Scholl:1999mi,Carey:2001ue,scholl:2007_objecta}.

The CLSTX conjecture:

Five-month-olds’ abilities to track briefly unperceived objects

are not grounded on belief or knowledge:

instead

they are consequences of the operations of

a system of object indexes.

Leslie et al (1989); Scholl and Leslie (1999); Carey and Xu (2001)

(‘CLSTX’ stands for Carey-Leslie-Scholl-Tremoulet-Xu \citep[see][]{Leslie:1998zk,Scholl:1999mi,Carey:2001ue,scholl:2007_objecta})
\emph{The CLSTX conjecture} Five-month-olds’ abilities to track occluded objects are not grounded on belief or knowledge: instead they are consequences of the operations of object indexes. \citep{Leslie:1998zk,Scholl:1999mi,Carey:2001ue,scholl:2007_objecta}.

The CLSTX conjecture:

Five-month-olds’ abilities to track briefly unperceived objects

are not grounded on belief or knowledge:

instead

they are consequences of the operations of

a system of object indexes.

Leslie et al (1989); Scholl and Leslie (1999); Carey and Xu (2001)

(‘CLSTX’ stands for Carey-Leslie-Scholl-Tremoulet-Xu \citep[see][]{Leslie:1998zk,Scholl:1999mi,Carey:2001ue,scholl:2007_objecta})
While I wouldn’t want to suggest that the evidence on siganture limits is decisive, I think it does motivate considering the hypothesis and its consequences. In what follows I will assume the hypothesis is true: infants’ abilities to track briefly occluded objects depend on a system of object indexes.
occlusionendarkening
violation-of-expectations

Charles & Rivera (2009)

How does help us with the puzzles?
Object indexes can survive occlusion ...
... but not the endarkening of a scence
But why do we get the opposite pattern with search measures?
So why do 5 month olds fail to manifest their ability to track briefly occluded objects by initiating searches for them after they have been fully occluded?
Because object indexes are independent of beliefs and do not by themselves support the initiation of action.
But we still have to explain this ...
Why do infants succeed in searching for momentarily endarkend objects? This finding seems to run directly against the CLSTX conjecture. After all, (1) object indexes do not survive endarkening; and (2) even if they did, they don’t enable you to initiate purposive actions. So the CLSTX conjecture provides two independent reasons to predict that 5-month-olds will \textbf{not} search for endarkened objects.
And yet they do. What does this mean?

An Objection:

What can object indexes explain?

Wynn 1992, fig 1 (part)

We know that infants are likely to maintain object indexes for the two mice while they are occluded. Accordingly, when the screen drops in the condition labelled ‘impossible outcome’, there is an interruption to the normal operation of object indexes: infants have assigned two object indexes but there is only one object. But why does this cause infants to look longer at in the ‘impossible outcome’ condition than in the ‘possible outcome’ condition? How does a difference in operations involving object indexes result in a difference in looking times?
occlusionendarkening
violation-of-expectations

Charles & Rivera (2009)

How does help us with the puzzles?
Object indexes can survive occlusion but ...