Difference between revisions of "Kino evaluations"
(→Kino (Kino Enterprise) Usecases) |
|||
| Line 3: | Line 3: | ||
# '''Biology oriented Web service annotation and retrieval''': Many organizations, such as the DNA Data Bank of Japan (DDBJ), provide service interfaces for biological data retrieval tasks (such as Gene prediction). Biologists typically search and browse through a service catalog such as BioCatalogue and import the relevant service descriptions to a composer tool. Biologist would have to use descriptive terms to extract the most suitable services. Often these terms are imprecise, and several attempts are needed to get to the exact service required for the task at hand. | # '''Biology oriented Web service annotation and retrieval''': Many organizations, such as the DNA Data Bank of Japan (DDBJ), provide service interfaces for biological data retrieval tasks (such as Gene prediction). Biologists typically search and browse through a service catalog such as BioCatalogue and import the relevant service descriptions to a composer tool. Biologist would have to use descriptive terms to extract the most suitable services. Often these terms are imprecise, and several attempts are needed to get to the exact service required for the task at hand. | ||
| − | # '''Scientific Document annotation''': The scientists at Sanger Institute perform document annotation through a labor intensive process. | + | # '''Scientific Document annotation''': The scientists at Sanger Institute perform document annotation through a labor intensive process. This is the process in Figure. |
| + | [[File:usecase_current_process.png]] | ||
== Empirical Evaluation == | == Empirical Evaluation == | ||
Revision as of 20:12, 23 September 2011
Contents
Kino (Kino Enterprise) Usecases
- Biology oriented Web service annotation and retrieval: Many organizations, such as the DNA Data Bank of Japan (DDBJ), provide service interfaces for biological data retrieval tasks (such as Gene prediction). Biologists typically search and browse through a service catalog such as BioCatalogue and import the relevant service descriptions to a composer tool. Biologist would have to use descriptive terms to extract the most suitable services. Often these terms are imprecise, and several attempts are needed to get to the exact service required for the task at hand.
- Scientific Document annotation: The scientists at Sanger Institute perform document annotation through a labor intensive process. This is the process in Figure.
Empirical Evaluation
Case 1: Improve in Recall
In the case of the Web service retrieval, we observed that BioCatalogue returns about 75 Web services for the search term gene prediction. However, it returns only 20 Web services for the term gene finding, even though gene prediction and gene finding are synonyms. Some of these commonly available synonyms that Kino managed to automatically add as synonyms are available online . The essence of these observations is that such synonyms and cross references have been added to existing ontologies with significant effort and investment; although, the lack of integration leads to underutilizing these resources. Ability to use these synonyms and possibly other details from the ontology improves recall.
Case 2: Convenience from the use of the browser plugin
By using the browser plugin, an alternate workflow for the cumbersome document annotation process was introduced. This new workflow is also available in the Kino evaluations page.
| Concept Label | Available Synonyms | Reference Concept Id * |
|---|---|---|
| row 1, cell 1 | row 1, cell 2 | row 1, cell 3 |
| row 2, cell 1 | row 2, cell 2 | row 2, cell 3 |
| row 3, cell 1 | row 3, cell 2 | row 3, cell 3 |
