I think it should be possible to analyze server logs (once browers support
``Referer: URL'' that is) and extract some of this information. LINK
commands could then be used to extend the structure beyond the local
server. This could fit in very nicely with Web robots.
Hope this is some food for thought.