Difference between revisions of "Knowledge-Aware-Search-Evaluation"
From Knoesis wiki
(→Scenario1) |
(→Scenario 2) |
||
| Line 41: | Line 41: | ||
|width="120pt" align="center" colspan="2" | ''Information Need'' || Does the document snippet discuss negative sentiments (or experiences) towards Buprenorphine use by an individual? | |width="120pt" align="center" colspan="2" | ''Information Need'' || Does the document snippet discuss negative sentiments (or experiences) towards Buprenorphine use by an individual? | ||
|- | |- | ||
| − | | colspan="2" rowspan=" | + | | colspan="2" rowspan="8" align="center" | ''Subset of User Composed Query <br /><font color="green">(used with Hakia, Google & DuckDuckGo)'' </font> |
|- | |- | ||
| colspan="2" | site:forum.opiophile.com buprenorphine side effect | | colspan="2" | site:forum.opiophile.com buprenorphine side effect | ||
| Line 57: | Line 57: | ||
| site:forum.opiophile.com "buprenorphine" ("horrible" OR "side effect") <br /> "buprenorphine" ("bad experience" OR "side effect") | | site:forum.opiophile.com "buprenorphine" ("horrible" OR "side effect") <br /> "buprenorphine" ("bad experience" OR "side effect") | ||
|- | |- | ||
| + | | rowspan="2" | To Query Our System || colspan="2" | using the specific user query (<Buprenorphine><PERSONAL_PRONOUN><NEGATIVE>) we provided, please perform the following steps. | ||
| + | |- | ||
| + | | colspan="2" | | ||
| + | # Upon access to the interface. Please select the third data source in the list, if not selected by default. <br /> | ||
| + | # Then carefully browse the dropdownlist and select the ontology nonterminal class '''ENTITY''' <br /> | ||
| + | ## Scroll through the dropdownlist and select the entity ''Buprenorphine'' <br /> | ||
| + | # Next select the nonterminal '''PRONOUN''' <br /> | ||
| + | ## Again carefully scroll through the dropdownlist and select the nonterminal ''PERSONAL_PRONOUN'' <br /> | ||
| + | # Then select the nonterminal '''SENTIMENT''' from the third dropdownlist <br /> | ||
| + | ## Scroll through the dropdownlist and select the nonterminal ''NEGATIVE'' <br /> | ||
| + | # Click Search. | ||
|} | |} | ||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
<font color="red">Note: If you make a mistake, then reload the page, and repeat these instructions. </font> | <font color="red">Note: If you make a mistake, then reload the page, and repeat these instructions. </font> | ||
Revision as of 05:26, 13 May 2013
Contents
[hide]Scenario1
The table below show the set of user queries forumulated across the three sites Google, Hakia and DuckDuckGo in response to the first query scenario, for the given information need. Note that we temporarily disclose the selected web-forum name here for evaluation purposes only.
| Information Need | Is the document sharing specific information on the use of Buprenorphine in dosages exceeding 4mg daily? | |
| Subset of User Defined Queries" (used with Hakia, Google & DuckDuckGo) | ||
| site:forum.opiophile.com daily buprenorphine dosage > 4mg | ||
| site:forum.opiophile.com using bupe more than 4mg | ||
| site:forum.opiophile.com buprenorphine dosage excess 4mg daily | ||
| site:forum.opiophile.com buprenorphine dosage more than 4mg daily | ||
| site:forum.opiophile.com buprenorphine dosage over 4mg daily | ||
| site:forum.opiophile.com (buprenorphine OR bup) dosage daily ("above 4mg" OR "over 4mg" OR "more than 4mg") | ||
| To Query Our System | <Buprenorphine><PERSONAL_PRONOUN>[> 4 mg]<BY_DAY | BY_HOUR> | |
# Upon access to the interface. Please select the third data source in the list, if not selected by default.
| ||
Note: If you make a mistake, then reload the page, and repeat these instructions.
Scenario 2
| Information Need | Does the document snippet discuss negative sentiments (or experiences) towards Buprenorphine use by an individual? | |
| Subset of User Composed Query (used with Hakia, Google & DuckDuckGo) | ||
| site:forum.opiophile.com buprenorphine side effect | ||
| site:forum.opiophile.com side effects for buprenorphine | ||
| site:forum.opiophile.com side effect for buprenophine | bup | bupe | bupes | suboxone | ||
| site:forum.opiophile.com buprenorphine bad experience | ||
| site:forum.opiophile.com "buprenorphine" "horrible experience" | ||
| site:forum.opiophile.com "buprenorphine" "horrible | ||
| site:forum.opiophile.com "buprenorphine" ("horrible" OR "side effect") "buprenorphine" ("bad experience" OR "side effect") | ||
| To Query Our System | using the specific user query (<Buprenorphine><PERSONAL_PRONOUN><NEGATIVE>) we provided, please perform the following steps. | |
| ||
Note: If you make a mistake, then reload the page, and repeat these instructions.
Scenario 3
| Information Need | Is the document sharing specific information on the use of Buprenorphine in dosages exceeding 4mg daily? |
| Provided User Query | site:forum.opiophile.com buprenorphine dosage excess 4mg daily |
To Query our system, repeat the steps in Scenario 1
Note: If you make a mistake, then reload the page, and repeat these instructions.
Scenario 4
| Information Need | Is the document snippet discuss discuss negative sentiments (or experiences) towards Buprenorphine use by an individual? |
| Provided User Query | site:forum.opiophile.com buprenorphine bad experience |
To Query our system, repeat the steps in Scenario 2
Note: If you make a mistake, then reload the page, and repeat these instructions.
