HOME   ::  Journal List   ::   Article

Elman, J. L. (1990) Finding structure in time. Cognitive Science, 14(2):179--211.
Bookmark:   ( bookmarked by 8 relevant users: garyfeng, livingthingdan, soramame_0518, preeder, cmunson, kira, gcrost, arnia ).   tags: 4time 2modeling 2connectionist devprosem rnn .................

Full-text
   || Go to publishers' web page for final fulltext/PDF. (see the Authoritative link as below)
   URL: http://www.cnbc.cmu.edu/~jlm/UNM_03_04/Elman90.pdf
   Cached: PDF-233K   
   SAVE AS an easy-to-recall long filename:
      Filename format: author--year--title   PDF-233K   
      Filename format: author--year--title--journal|proceedings|...--pages   PDF-233K   

Related links
   Authoritative: http://dx.doi.org/10.1016/0364-0213(90)90002-E   (Publisher's PDF... likely be available here.)
  Web search: Google Web Search   ::   Google Scholar
  Within this site: Cited by (49)    References (42)

Abstract

Time underlies many interesting human behaviors. Thus, the question of how to represent time in connectionist models is very important. One approach is to represent time implicitly by its effects on processing rather than explicitly (as in a spatial representation). The current report develops a proposal along these lines first described by Jordan (1986) which involves the use of recurrent links in order to provide networks with a dynamic memory. In this approach, hidden unit patterns are fed back to themselves; the internal representations which develop thus reflect task demands in the context of prior internal states. A set of simulations is reported which range from relatively simple problems (temporal version of XOR) to discovering syntactic/semantic features for words. The networks are able to learn interesting internal representations which incorporate task demands with memory demands; indeed, in this approach the notion of memory is inextricably bound up with task processing. These representations reveal a rich structure, which allows them to be highly context-dependent while also expressing generalizations across classes of items. These representations suggest a method for representing lexical categories and the type/token distinction.
BibTex
@article{elman90findingStructure,
  author={Jeffrey L. Elman},
  title={Finding structure in time},
  journal={Cognitive Science},
  year={1990},
  volume={14},
  number={2},
  pages={179--211},
  doi={10.1016/0364-0213(90)90002-E},
  url={http://www.isrl.uiuc.edu/~amag/langev/paper/elman90findingStructure.html}
}


 HOME   ::  Journal List   ::   Article Comments to: junwang4 you-know-at gmail.com Last update: 2/2/08