Endeca - Aiming for integrated search/BI

Endeca Stresses Simplicity With New Partnerships by Theresa Cramer, Newsbreaks (Oct 29)

Endeca is partnering with Informatica and SAP in a bid to integrate search with business intelligence.

"Under the terms of the OEM agreement, Endeca will integrate Xcelsius software, SAP BusinessObjects Intelligent Search software, PowerCenter, and PowerExchange into the Endeca Information Access Platform. These partnerships will address two very different issues for Endeca and its customers, says Sonderegger."

Inxight, now part of SAP, turns up in this too.

"There is also a little something in this new partnership for Endeca's intelligence customers, namely, the licensing of SAP's query federation tool, Inxight SmartDiscovery Awareness Server. Intelligence customers will be able to send off a query about "uranium enrichment," for example, to multiple information sources such as Endeca applications, proprietary databases, The New York Times, and The Washington Post and expect to see results in one screen. "This comes straight from the traditional search world," says Sonderegger. "We've added our own twist. ... When results come back, the analyst will be able to do faceted browsing across search results.""

The Taxonomists Career

Becoming a Taxonomist: Real Life Stories by Karen Loasby, FUMSI (Oct 2009)

Four information taxonomists tell their career stories - Heather Hedden, Helen Lippell, Dorothy Tuma and Stephen D'Arcy. We see a mix of indexing, information architecture, information management. There are many backgrounds, such as Dorothy's "In addition to abetting my creative avocations, getting my MFA taught me to think about concepts, meaning, semantics, aboutness, and implicit versus explicit meaning. "

Information Access Technology from Gartner

Gartner has issued its 2009 Magic Quadrant for Information Access Technology (Sept 2009)

The overall description is a fair representation of enterprise search technology today. Selecting the vendor is only one step. A much larger one is to make the technology meet an organization's information needs - an endeavour that takes much planning and much adaption of both the technology and the organization.

"This Magic Quadrant assesses vendors with capabilities that go beyond enterprise search to encompass a range of technologies. Their capabilities include: search; federated search, content analytics, such as content classification, categorization and clustering, fact and entity extraction, taxonomy creation and management, information presentation (for example, visualization) to support analysis and understanding; and desktop search to address user-controlled repositories to locate and "invoke" documents, data and e-mail."

Gartner included vendors that have search as the foundation piece. It notes that "Many include other capabilities such as autocategorization, taxonomy functions and clustering, but we excluded those that offer only these capabilities, with no search."

Companies to note: Autonomy, Endeca, Exalead, IBM, Microsoft, Oracle, Recommind, Vivisimo. (There are others.)

Unfortunately the report does not describe the specific capabilities of the vendors.

Not Otherwise Categorized

Add this blog - Not Otherwise Categorized - to the reading list. This comes from Seth Earley and Associates and has several contributors. Caategories include content management, taxonomy, semantic web, Sharepoint (MOSS) and much else. Not a high volume blog, but has some very good reading.

Taxonomy Jargon Explained

What’s the difference between Taxonomies and Ontologies? - Ask Dr. Search at New Idea Engineering (June 2009)

Excellent question - excellent answer. These words are often interchangeable - but it depends on the person, as Dr Search explains. The casual user might use either term, but the "deep researcher" might prefer ontology. Dr Search suggests that ontology is the big sweeping pictureof knowledge, and the taxonomy more specific subject domain. There are differences in understanding in computer science context also.

"Beyond academic precision, ontologies try to represent knowledge in a form so carefully that even computers can derive meaning by traversing the various relationships. If a computer were actually relying on this data you can understand that the “is-a” relationship in “Obama is-a president” and “my boss is-a huge pain” have slightly different meanings, the former conferring a job function, the latter a behavioral attribute. Unless you are a researcher or vendor of this technology, most people don’t need to worry about this.

Taxonomies can also be read and used in computer software, for example Verity’s Topic Sets were a form of taxonomy, and could be loaded into a profiler to classify incoming documents; many other companies have had this idea as well. But the linkages between parent and child branches were much simpler in nature, and were designed to simply combine fulltext search terms in various ways. There was no hint of “understanding” in the relationship between a parent and child, beyond simple fulltext matching. This was still very advanced for its time (the late 1980s), but it didn’t attempt to encode meaning."

There are many other terms that may come into the discussion that are related to use of taxonomies such as topic trees, knowledge base, folksonomy (not the same at all), tagging. and sometimes natural language processing (which might be used to help create a taxonomy) and metadata.

Taxonomy is also discussed in Do You Need A Taxonomy? where it is explained that there are three types: Subject based (a subject domain), Content based (derived from the content), and Behaviour (not as clear - might be usage).

Transparent semantic search at Lexis Nexis

Semantic technology is being adopted more for search processing. LexisNexis, known for legal research tools, is enhancing those with a greater understanding of the meaning of content and, according to this press release, is also revealing what it has done to the searcher. Most semantic search engines seem to work like magic - they just "do" and the searcher must accept on faith.


LexisNexis Introduces Transparent Semantic Search Technology for Patent Research, Business Wire (Oct 12)

"Through a development alliance with Dallas-based Pure Discovery, LexisNexis has become the first provider of legal information services to integrate the power of semantic search technology with familiar Boolean search technology, giving the user greater control over the patent research process via a simple, streamlined user interface that matches their typical daily workflow. "

Intute Thesaurus Removed

Intute has removed its thesaurus for social science. This announcement - The Thesaurus Engine service has been withdrawn - suggests that it did not "align" with UK higher education courses. Odd - would be helpful for students to learn about and use thesauri.

Search Solutions 2009

I recently attended the Search Solutions 2009 one day conference. For an excellent summary of a very interesting day take a look at Karen's recent blog post

For me, 'a star of the show' was Dave Mountain's enthralling discussion, "Location-Based Services: Positioning, Geocontent and Location-Aware Applications". Dave looked at location based services, their current uses and future possibilities. One aspect, which sparked heated debate over coffee, was the very real security implications of having your position pinpointed to a couple of metres. Location Based Services will I think continue to grow and meld together with social applications such as Twitter, Facebook, Flickr, e-commerce and mobile devices. We will increasingly know where the nearest coffee shop is to our location in terms of direct route, time taken to get there etc. Add to this the possibility that everyone else will know where you are in real time and what you're doing and you have a world of many information and privacy challenges. I wonder whether we'll end up with people paying a surcharge to cloak themselves from all this information gathering?

If you want to know more about the world of Geocontent and Location Aware Applications Dave Mountain is a great person to talk to.

Ian

FUMSI Taxonomy Survey

Participate in this taxonomy survey by FUMSI and you'll receive a copy of the results. This group is investigating "the ways organisations of all types implement and leverage taxonomies, folksonomies and other tagging and classification systems".

Tutorial on Constructing a Thesaurus

Tim Craven, Professor Emeritus at The University of Western Ontario, makes available resources he had developed for courses in the Library and Information field. One of these is a Web-based module that teaches the basics of constructing an information retrieval thesaurus and includes interactive quizzes.

See this and some other resources at http://publish.uwo.ca/~craven/