MIND AGENT PROJECT

As the title well explains, this is an extract from the MIND AGENT PROJECT concept proposal. "MAP: A theoretical investigation into the design of a cognitive augmentation system" was my major project at university and wound up being one of three (out of 170) projects short listed for the ‘HSBC Innovation Award’ at the ‘MADE IN BRUNEL Innovation Show’. It may be hard to grasp some of the ideas without the backing research and further elaborations of the ideas presented but it's as much as I'm willing to post! See what you make of it!


3.1. Concept Proposal

“We must learn to balance the material wonders of technology with the spiritual demands of our human nature.”
(John Naisbitt)

The rise of the age of the computer has been swift and has brought about incommensurable changes to mankind. It is hard to sum up the role of computing in science, culture, society, politics, entertainment and so on because ultimately it has become integral parts of all these systems. What can be said, and to reiterate Rheinghold’s words, is that computer’s are “tools for thought”, they augment human activities by providing a medium to manage and make use of information. The variety of uses stem from the fact that computers are not enormous mainframes that carry out specific tasks anymore; computers are the “universal machines” that Turing described; consequently as hardware and programming evolves we will see computing take on new forms and functions defined by developers’ visions and concepts.

As we have seen, many of the ‘pioneers’ saw the potential of computing to augment human intellect. This effect can certainly be said to be true, particularly in extending human intellect. A student may use his computer as a workstation, a communication device, a research portal and an entertainment suite just to name a few examples, and many times they serve all these functions simultaneously. The skills involved in managing a computer with this layout involves a great deal of multi-tasking, problem solving, and information management skills. This is a scaled down scenario, as any savvy user knows, using a computer is a constant and non-linear process moving from one thought to the next, from task to task, working with an array of virtual-intellectual tools. The computer becomes an extension of the user’s intellectual will, a medium to carry it out, and a constant source of thought provoking situations.

The thought processes involved in using a computer are on the one hand those of the reason for using it, and on the other hand those regarding how to use the computer to attain the desired purpose. It seems that a better knowledge and control of a digital system enhances the user’s experience. As Rheingold describes;

“any later-day hacker will admit that the most fascinating thing in his own life is his own mind, and tell you that he regards intense, prolonged interaction with a computer program as a particularly satisfying kind of dialogue with his own thoughts.”

An ideal system would provide this type of intellectual satisfaction, not only with the support we are used to, but with an appreciable contribution to thinking processes. That is one of the reasons why HCI research attempts to bring computing closer to people (just as experts attempt to move closer to computers), because it is from that natural and unimpeded closeness that the true potential of human-computer interaction arises.



The concept behind the MIND AGENT PROJECT (forms M.A.P. acronym, as in ‘mapping’) is to create a system that provides this closeness in an environment dedicated to enhancing the users abilities to document his thoughts, to visualize them, to rearrange them, and to gain new meanings and insights them.

The purpose of this system is to carry out methodologies like those proposed by De Bono and Buzan, to think divergently and ‘out of the box’, and to explore new approaches to problem solving. MIND AGENT would serve as a tool to facilitate these processes by allowing users to map ideas into a rich visual interface. Voice commands could allow for rapid input of keywords (that could later be elaborated), and interfaces like a multi-touch screen would allow for rapid reconfiguration of interactive diagrams. Idea databases could quickly be assembled, with the ability to link words, themes and media, creating a system of “associative trails” that could be represented in a variety of different formats and visual structures.


Alan Kay described the idea of “agents [as] computer processes that act as guide, as coach, and as amanuensis”86. It is from this definition that MIND AGENT earns its name. The system would not provide augmentation, but would instead assist and aid the user in carrying out augmenting methodologies. The incorporation of eye and head tracking technology would therefore not only provide an effective form of navigating large visualisations in a smooth and unconfined manner, but would also provide feedback to the user on his performance. By monitoring eye movements the system could provide information regarding the user’s interests (areas of most prolonged fixations in the form of heat maps for example) as well as monitor his attention (exterior manifestations thereof, for example eyes wandering during reading).

Sound knowledge of metacognitive strategies would allow the user to use this feedback as instructive ‘coaching’. This would reinforce self initiated goals like speed reading by monitoring speed, regression, and wanderings, and providing metronome training and progressive speed increase programs.

It would be all too easy to assume that every user would want to take the initiative to improve his learning and cognition. These types of methodologies are not universally accepted because they take a great level of commitment and self-regulation to be set in motion in the fist place. A MIND AGENT could promote these ideas by providing a starters guide to using the system, introducing concepts of cognitive augmentation, brainstorming, mind mapping and metacognition. Clearly this tool system would be most suited to persons acquainted with, and open to, these ideas but would not be exclusive to them.

This system could be incorporated into a user’s work station (for example) and be used just like any other application. In fact it would be desirable if it ran contiguously to have constant access to ‘linkable’ information that would later be explored in dedicated ‘thinking sessions’, and monitoring for cognitive and metacognitive feedback.

The desired result of MIND AGENT would enhance productivity by supporting knowledge management and discovery, promote and enhance learning, and focus concentration and attention, analogous to the “improved productivity of a craftsman who has the right tools and an ample workbench”. If the system proved effective it could suggest a step towards type of Man-Computer Symbiosis that Licklider described, and a new page for the augmentation Engelbart sought.