Measuring Knowledge

The bucket, not the contents

There is no intrinsic definition of knowledge.  There is no unit for knowledge.  There is no way to empirically measure it.  There is no independent yardstick against which we can empirically quantify knowledge in DNA, in a person, in a piece of machinery, in a book, or in a computer program.

This presents us with problems.

As we have seen earlier, the only way we can qualify knowledge (assert it is “correct”) is to compare it against another source of knowledge (which, of course, would in its turn need to be compared against yet another source of knowledge).  The same is also true of quantifying knowledge.  But quantification is arguably even less well-defined than qualification—we are usually better able to say “…this knowledge is ‘correct’...” than we are to say “…this knowledge is 'enough'…” 

Both qualification and quantification of knowledge in a person (and other media) are usually achieved through some examination process.  After undergoing some standardized test under controlled circumstances, a person’s accessible knowledge is assessed by comparing it against some standardized knowledge store.  This comparison purports to assess both the quality (how close the answers come to the “correct” answers) and the quantity (how many answers came close to the “correct” answers).  In highly standardized tests, these are often congruent: for a well-defined multiple-choice test, any answer that does not match the “correct” answer is considered to be simply wrong and doesn’t count toward the quantity total.  For essay-type questions, the quality and quantity might be somewhat decoupled: the person might get some of the ideas “correct” but not all of them.  This is where the professor’s skill (and knowledge base and biases) in marking exam results comes in.

Notice, I referenced “correct” in quotes.  An answer is deemed correct only insofar as it matches the “correct” answer, that being determined by the comparative knowledge source and comparison process.  Since the “correct” answer was itself compared against something else, which in turn was compared against something else, ad infinitum, there is no point at which empirical correctness can be truly asserted (or, in most cases, proven [1]).

So, we cannot measure knowledge directly...

...but we can measure the physical characteristics of its substrate.


FOOTNOTES


[1] That said, most mathematical and many philosophical systems start with an axiomatic basis.  Axioms, by definition, are considered to be self-evidently true and do not require proof.  Indeed, true axioms cannot usually be “proven” (against what?)  This means such systems are built on things which we realize cannot be asserted to be intrinsically  “correct.”  But we have to start somewhere, right?  From such a basis, it is entirely appropriate to assert that well-formed theorems built on the axiomatic basis are, in fact, proven.  We will talk about this later.
However, the universally accepted practice of building enormous, elaborate logic structures based on an acknowledged unprovable foundation is further evidence of the non-measurability of knowledge.