Google's Adam Bosworth Talks to the Gilmor Gang

Thread Title:
The Gillmor Gang with guest Adam Bosworth
Thread Description:

Dust off your headphones and settle back for a pretty interesting listen from the Gilmor Gang with special Guest Adam Bosworth of recent open source scandal fame. See the threadlink above for the mp3 stream. He's an interestin fella...

Adam Bosworth, now Google's VP of Engineering, joins The Gang this week to discuss his vision for the future of search architecture. "How do you handle data that's much less known up front and where the query is by relevance?" Adam asks. Most of today's databases are built on the relational model, but most of today's queries are not. Instead they're looking for keyword precision, location and semantic context -- not a textual or numeric match. The relational model is designed for use when both the data and the queries can be anticipated, but in today's world, neither are typically known in advance.

Adam suggests that the same divide-and-conquer architectures used to make web servers more scalable could be used in search. He envisions data routers that will know which back-end servers have which knowledge and will query servers asynchronously according to the liklihood of getting the best results.

I started listening to this very late last night but missed who the Google guy was heh.. just saw Scoble post this though so thanks!