definition: "A program that [...] provides assistance to a user dealing with a particular application. Such agents learn by watching over the shoulder of the user and detecting patterns and regularities..." (Maes)
This approach aims to overcome the limitations of the direct manipulation paradigm when a system becomes too complex to understand or manage.
(slide presentation by Radhakrishnan)
options: (Maes)
- user-programmed
- AI-engineered
- learning agents
forces: several criteria will help to choose between the different options:
- simplicity
- commercial availability
- "smartness"
- adaptability
example:
Mail-filtering [2]: uses RoteLearning and clustering techniques by storing a set of situation-action pairs. In a given situation, the proper action to trigger is calculated the following way:
- calculate the distance between the current situation and all the memorized situations
- choose the most appropriate action amongst the N closest situations (k-closest neighbors clustering technique)
- calculate the "score" of the action, which determines if the action should be only suggested ("tell-me" threshold) or triggered ("do-it" threshold)
It is possible to "forget" old cases, in order to help the system to adapt and to avoid it to slow down. Furthermore, there are 3 other types of learning that can help improve the system:
- learning by feedback
- learning by training: the user enters useful cases him/herself
- multi-agent learning: the agent consults other agents when the score is too low. This requires the agent to trust its peers.
other examples:
- spam filtering (Sahami et al. [1])
- note-taking (Schlimmer & Hermens), uses grammatical inference
- programming (Ruvini)
- playing soccer, playing games, network management (me and my students!)
- AdBlockLearner
- news filtering (see book)
see also: the following borderline cases of interface agents:
- Learning from Observation (Ontanon, Floyd, Veloso, etc.). Other related terms: Learning by Demonstration, Imitation Learning, etc.
- My Yahoo [4], powered by Firefly
- Bargain Finder (Andersen Consulting)
- Kasbah, Jango (MIT)
code:
See book.
back to SoftwareAgentCourse
(last edited May 25, 2017)
Find Page by browsing or searching