The Intrinsic Likelihood of Things

The latest addition to the YooName engine consists of prior probability correction. Without going into statistical details, it creates a bias to make belong to a named entity class by default. It is very important because contextual disambiguation is not always enough to classify named entities. Here is an example. Consider this sentence:

David wants to finish the sculpture so he puts a lot of pressure on Pascal.

For the human reader, David and Pascal are obviously names of persons.

For the machine, David is the name of

  • a person,
  • a sculpture,
  • a food brand.

Pascal is the name of

  • a person,
  • a measurement unit.

Using statistical analysis of the context, disambiguation rules can be fooled into thinking that David is a sculpture (because the word “sculpture” is used in this context) and that Pascal is a measure (because the word “pressure” is used in this context). That’s why knowledge of prior probabilities is important. More often, “David” stands for a person rather than anything else. The same goes for “Pascal.” That means these word will only be classified as something else if there is strong contextual evidence to support it (e.g., a number precedes “Pascal”).

In conventional supervised (machine) learning, prior probabilities are estimated according to their frequency in the training corpus of annotated data. In semi-supervised learning, the annotated data is artificially created by the judicious sampling of a large collection of unannotated data. In YooName, this mechanism cancels out prior probabilities calculated from the training corpus. That’s why prior probability correction is necessary. We’ve used a variant of PMI-IR to approximate prior probabilities in an unsupervised manner, and YooName’s precision has significantly improved.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: