Patent No. 6377833 System and method for computer input of dynamic mental information

 

Patent No. 6377833

System and method for computer input of dynamic mental information (Albert, Apr 23, 2002)

Abstract

A system calibrates a user's brain region (e.g., the primary visual cortex or V1 region) to actual sensory information (e.g., the visual field), and enables imagined sensory information (e.g.; dynamic mental imagery) to be interpreted as computer input. The system includes a configuration engine and an input device control engine. The configuration engine includes a test pattern; a functional information gatherer for presenting the test pattern to a user; a brain-scanning device interface for obtaining functional information from a region in the user's brain that provides a physiological response to the test pattern and that receives feedback corresponding to imagined sensory information; and a mapping engine for using the functional information to map the user's brain region to the test pattern. The input device control engine includes a brain-scanning device interface for obtaining functional information from a brain region that provides a physiological response to actual sensory information and that receives feedback corresponding to imagined sensory information; an interpretation engine for interpreting the feedback; and a computer control engine for using the interpreted feedback as computer input.

Notes:

System and method for computer input of dynamic mental information. Filed September 1999, granted April 2002. This would be a very effective aid in the detection of the psychotronic attacks. Unfortunately, it would also need to be used in conjunction with a system that detects the broadcasts and correlates them what it does, otherwise it would probably be used to misdiagnose someone under attack. This patent also describes what is (or could be) done with the data collected from remote neural monitoring pretty well. The patent specifically states that other forms of brain-scanning devices may be used instead of MRI. The physiological responses mentioned in the patent would be the electrical impulses in the brain that correspond directly to the evoked potentials in an EEG reading. The patent also mentions that it can be used for more than one area of the brain at a time or all at once. The 3d to 2d (d = dimensional) would mean they could view it like a television screen. However this could also be turned right back into 3d for display in a virtual reality type of system or can even use both together as described in other patents on the list.

BACKGROUND OF THE INVENTION

1. Field of the Invention

This invention relates generally to computer input devices, and more particularly provides a system and method for computer input of dynamic mental information such as visual mental imagery.

2. Description of the Background Art

Conventional computer input devices include keyboards, mice, tracker balls, touch sensitive displays and microphones. Each of these input devices translate physical actions by a user into computer instructions. For example, a computer may recognize mouse movement as a computer instruction to move a pointer and may recognize key depression on a keyboard as a computer instruction to generate text.

For physically disabled individuals who cannot control a mouse, type on a keyboard or speak into a microphone, computer input is difficult and potentially impossible. There have been several studies into the use of bioelectrical activity in the brain to control a pointer device. An article by John Charles, entitled "Neural Interfaces Link the Mind and the Machine," indicates that, by recognizing particular electrical biosignals such as electroencephalograph (EEG), electrooculograph (EOG) and electromyograph (EMG), it is possible to move a computer pointer. However, this technique does not enable computer input of text, images, sound, body movement or other sensory information to a computer.

Therefore, a system and method enabling computer input of dynamic mental information are needed.

SUMMARY OF THE INVENTION

Images on the retina are geometric mappings (projections) of what a person sees. These images are carried to a region in the visual cortex commonly referred to as the V1 region (or the primary visual cortex). The V1 region is retinotopically mapped, i.e., the physical locations of the activated neurons in the V1 region are a geometric mapping (homeomorphism) of the image on the retina. The image in the V1 region can be and has been read by using brain-scanning instruments such as functional magnetic resonance imaging (functional MRI) or positron emission tomography (PET). Neurons then carry the signals out of the V1 region and into deeper regions of the brain, which are not geometrically mapped. It has been recently recognized that there is feedback from those deeper regions back to the V1 region. It has also been recently recognized that this feedback includes images generated by the imagination. Accordingly, a system embodying the present invention reads these feedback signals to obtain and interpret this dynamic mental imagery as computer input.

It will be appreciated that other brain regions (e.g., the auditory cortex, the somatosensory cortex, etc.) may similarly provide physiological responses to other actual sensory information (e.g., sounds and voices, body movement, etc.) and may similarly receive feedback to other imagined sensory information (e.g., imagined sounds and voices, imagined body movement, etc.). Preferably, the other brain regions are large enough to distinguish content, are mapped according to a continuous sensory quantity, and receive feedback corresponding to that quantity. Accordingly, all sensory modalities could be used together to control a virtual reality system.

The system of the present invention calibrates a user's brain region (e.g., the primary visual cortex or V1 region) to actual sensory information (e.g., the visual field), and enables imagined sensory information (e.g., dynamic mental imagery) to be interpreted as computer input. The system comprises a configuration engine and an input device control engine. The configuration engine includes a test pattern; a functional information gatherer for presenting the test pattern to a user; a brain-scanning device interface for obtaining functional information from a region in the user's brain that provides a physiological response to the test pattern and that receives feedback corresponding to imagined sensory information; and a mapping engine for using the functional information to map the user's brain region to the test pattern. The input device control engine includes a brain-scanning device interface for obtaining functional information from a brain region that provides a physiological response to actual sensory information and that receives feedback corresponding to imagined sensory information; an interpretation engine for interpreting the feedback; and a computer control engine for using the interpreted feedback as computer input.

The present invention further provides a method for calibrating a user's brain region to actual sensory information, and enables imagined sensory information to be interpreted as computer input. The method comprises a configuration process and a computer input process. The configuration process includes presenting a test pattern to a user; obtaining functional information from a region in the user's brain that provides a physiological response to the test pattern and that receives feedback corresponding to imagined sensory information; and using the functional information to map the user's brain region to the test pattern. The computer input process includes obtaining functional information from a brain region that provides a physiological response to actual sensory information and that receives feedback corresponding to imagined sensory information; interpreting the feedback; and using the interpreted feedback as computer input.

The system and method of the present invention may advantageously enable computer input of imagined sensory information such as imagined images, imagined sounds, imagined body movements, etc. Accordingly, an individual unable to manipulate conventional computer input devices may be able to control a computer using only thoughts and imagination. Further, computer input of imagined sensory information may be faster than traditional computer input. Still further, since computer input is effected via the imagination, drawing ability is not as crucial.

-------------------------------------------

The foregoing description of the preferred embodiments of the present invention is by way of example only, and other variations and modifications of the above-described embodiments and methods are possible in light of the foregoing teaching. Although the nodes are being described as separate and distinct nodes, one skilled in the art will recognize that these nodes may be a part of an integral node, may each include portions of multiple nodes, or may include combinations of single and multiple nodes. Further, components of this invention may be implemented using a programmed general purpose digital computer, using application specific integrated circuits, or using a network of interconnected conventional components and circuits. Connections may be wired, wireless, modem, etc. Still further, although some transformation functions are being described as algorithms or tables, one skilled in the art will recognize that other functions such as matrices, diagrams, plots, graphs or other functions are also possible. The embodiments described herein are not intended to be exhaustive or limiting. The present invention is limited only by the following claims.