We introduce an automatic agent that, through linguistic communication with a human, can check constraints for object layouts as well as learn new constraints. This is applied to a surgical instrument preparation task, where the system interacts with an expert to learn both general instrument arrangement regulations and special layouts customized to a particular doctor. When supervising a non-expert human preparing the tools for a surgery, the system can provide suggestions by giving verbal feedback about how to improve the setup while simultaneously highlighting corresponding objects through a graphical interface.
By: Lanbo She, Jonathan Connell
Published in: RC25632 in 2016
LIMITED DISTRIBUTION NOTICE:
This Research Report is available. This report has been submitted for publication outside of IBM and will probably be copyrighted if accepted for publication. It has been issued as a Research Report for early dissemination of its contents. In view of the transfer of copyright to the outside publisher, its distribution outside of IBM prior to publication should be limited to peer communications and specific requests. After outside publication, requests should be filled only by reprints or legally obtained copies of the article (e.g., payment of royalties). I have read and understand this notice and am a member of the scientific community outside or inside of IBM seeking a single copy only.
Questions about this service can be mailed to reports@us.ibm.com .