Perceiving and Acting
1. The Problem
give the system sensorimotor capability, so as to directly interact with the world (rather than with other systems in a language), or as the front-end/back-end of a language interface
key issues: uncertain and real-time I/O with raw (non-symbolic) data
2. Proposed Solutions
speech:
- recognition: acoustic-phonetic structure vs. statistical pattern
- basic: P(words|signal) = P(signal|words)*P(words)/P(signal)
- signal is digitized with extracted features, segmentation
- take context into account
- generation: speech synthesis
- music perception and composition
vision:
- image processing as the reverse of image formation
- multi-stage bottom-up processing
- object recognition: feature based
- active vision
and eye movement
robotics:
agent as softbot
3. Issues
perception: passive vs. active, objective vs. subjective
bottom-up and top-down in perception and action
integration of conceptual-perceptual-operational components
embodied and situated cognition: what is the difference?
4. Reading
Section 15.6; Chapters 24, 25
5. ideas
- perception as patterns and relations built by actions
- sensorimotor unified with high-level cognition: pattern, skill, and concept; recognition and categorization
- perception organizing experience, rather than modeling the world; active, subjective, goal-directed, and knowledge-based
- the meaning of an action is its expeirenced conditions and consequences
- reaction and planning are both special cases of action-related reasoning
- stimulus/response in animal, computer, and human
- embodied and situated cognition: not an issue about hardware, but theory