Why no sparql for each question ?

[WaNePr]

Thanks for the dataset, but why there is no sparql query for each question ?

[kelvin-jiang]

Hi,

These results were extracted from a preprocessed version of Freebase, so we did not use SPARQL queries.

Kelvin

[WaNePr]

If no SPARQL queries is provided, how to use this dataset properly ?

[kelvin-jiang]

The dataset includes the Freebase MIDs that directly corresponds to entities in Freebase. Also, a subset of Freebase (preprocessed) has been linked in the README.

[WaNePr]

i see, but to simulate the execution of sparql query, shouldn't we know the query form, e.g. SELECT, ASK, SELECT DISTINCT etc. ?

[kelvin-jiang]

Unfortunately, I was not the one that worked on preprocessing Freebase, so I can't provide you with some sample SPARQL queries. Sorry about that.

[WaNePr]

I am wondering how to check the correct answer of question if only the variables and predicates are known but not the format.
Do you mind if you cound point out the person who responsible for the pre-processing or refer this question to him ?

Many thanks !

[kelvin-jiang]

I'm not sure what you mean by format, but the object node in each Freebase triple is always the answer to the question.

[WaNePr]

How do you evaluate the result ?

[WaNePr]

Is it possible to provide the pre-processing files and the evaluation scripts so that we know how to evaluate the result

[kelvin-jiang]

This dataset should be used to evaluate your KBQA results, there is no need to evaluate it. It was previously labelled and assessed by human annotators.

[WaNePr]

I do know that the dataset is labelled and assessed by human annotators.

My question is , I see that you provided a subset of Freebase (2.2GB zip) for evaluations, but in the subset, only the EntityMid is given but not the corresponding EntityName. Therefore i would like to know where i could find a NameFile for the subset, so that we could do the evaluation if we use this dataset ?
p.s. It could be generated in pre-processing, that's why i ask if you could share the pre-processing files.

Many Thanks.

[kelvin-jiang]

If you want to get from EntityMid to EntityName, use the type.object.name predicates within the Freebase subset. They map a Freebase MID to its name, and you can filter its tag (e.g. @en) to get language-specific names. An example in the subset: m.010gj6wc type.object.name "Prague"@en.

[WaNePr]

All EntityMid within the subset can be indexed this way ?

[kelvin-jiang]

Yes, should be, this is all straight from the original Freebase data dumps. Therefore, it may be possible for some unpopular Freebase MIDs to be missing labels.

[WaNePr]

But the 'unpopular Freebase MIDs without labels are not in the FreebaseQA dataset , am i right ?