Difference between revisions of "Entity Summary"
From Knoesis wiki
| Line 5: | Line 5: | ||
== Evaluation == | == Evaluation == | ||
| + | |||
| + | {| class="wikitable" | ||
| + | ! System | ||
| + | ! style="font-style: italic;" | k = 5 | ||
| + | ! FACES % ↑ | ||
| + | ! style="font-style: italic;" | k = 10 | ||
| + | ! FACES % ↑ | ||
| + | ! time/entity in seconds | ||
| + | |- | ||
| + | | FACES | ||
| + | | 1.4314 | ||
| + | | NA | ||
| + | | 4.3350 | ||
| + | | NA | ||
| + | | 0.76 sec. | ||
| + | |- | ||
| + | | RELIN | ||
| + | | 0.4981 | ||
| + | | 187 % | ||
| + | | 2.5188 | ||
| + | | 72 % | ||
| + | | 10.96 sec. | ||
| + | |- | ||
| + | | RELINM | ||
| + | | 0.6008 | ||
| + | | 138 % | ||
| + | | 3.0906 | ||
| + | | 40 % | ||
| + | | 11.08 sec. | ||
| + | |- | ||
| + | | SUMMARUM | ||
| + | | 1.2249 | ||
| + | | 17 % | ||
| + | | 3.4207 | ||
| + | | 27 % | ||
| + | | NA | ||
| + | |- | ||
| + | | Ideal summ agreement | ||
| + | | 1.9168 | ||
| + | | | ||
| + | | 4.6415 | ||
| + | | | ||
| + | | | ||
| + | |+ align="bottom" style="caption-side: bottom" Table 1. Evaluating the quality of summaries under each setting, % quality improvement (↑) using FACES compared to others for k=5 and k=10, respectively and average time taken per entity. | ||
| + | |||
| + | |} | ||
| + | |||
| + | |||
=== Dataset === | === Dataset === | ||
Evauation data is available for download [http://knoesis.wright.edu/researchers/kalpa/faces_evaluation.zip download] | Evauation data is available for download [http://knoesis.wright.edu/researchers/kalpa/faces_evaluation.zip download] | ||
Revision as of 21:37, 13 May 2014
Creating Faceted (divesified) Entity Summaries
Creating entity summaries has been of contemporary interest in the Semantic Web community in the recet past. In our approach called FACES: FACed Entity Summaries, we are interested in generating diversified and user friendly summaries.
Evaluation
| System | k = 5 | FACES % ↑ | k = 10 | FACES % ↑ | time/entity in seconds |
|---|---|---|---|---|---|
| FACES | 1.4314 | NA | 4.3350 | NA | 0.76 sec. |
| RELIN | 0.4981 | 187 % | 2.5188 | 72 % | 10.96 sec. |
| RELINM | 0.6008 | 138 % | 3.0906 | 40 % | 11.08 sec. |
| SUMMARUM | 1.2249 | 17 % | 3.4207 | 27 % | NA |
| Ideal summ agreement | 1.9168 | 4.6415 |
Dataset
Evauation data is available for download download
