May 10, 2007 feature
Numbers follow a surprising law of digits, and scientists can't explain why
Does your house address start with a 1? According to a strange mathematical law, about 1/3 of house numbers have 1 as their first digit. The same holds true for many other areas that have almost nothing in common: the Dow Jones index history, size of files stored on a PC, the length of the world鈥檚 rivers, the numbers in newspapers鈥� front page headlines, and many more.
The law is called Benford鈥檚 law after its (second) founder, Frank Benford, who discovered it in 1935 as a physicist at General Electric. The law tells how often each number (from 1 to 9) appears as the first significant digit in a very diverse range of data sets.
Besides the number 1 consistently appearing about 1/3 of the time, number 2 appears with a frequency of 17.6%, number 3 at 12.5%, on down to number 9 at 4.6%. In mathematical terms, this logarithmic law is written as F(d) = log[1 + (1/d)], where F is the frequency and d is the digit in question.
If this sounds kind of strange, scientists Jes煤s Torres, Sonsoles Fern谩ndez, Antonio Gamero, and Antonio Sola from the Universidad de Cordoba also call the feature surprising. The scientists published a letter in the European Journal of 麻豆淫院ics called 鈥淗ow do numbers begin? (The first digit law),鈥� which gives a short historical review of the law. Their paper also includes useful applications and explains that no one has been able to provide an underlying reason for the consistent frequencies.
鈥淭he Benford law has been an intriguing question for me for years, ever since I read about it,鈥� Torres, who specializes in plasma physics, told 麻豆淫院Org.com. 鈥淚 have used it as a surprising example at statistical physics classes to arouse the curiosity of my pupils.鈥�
Torres et al. explain that, before Benford, a highly esteemed astronomer named Simon Newcomb discovered the law in 1881, although Newcomb鈥檚 contemporaries did not pay much attention to his publication. Both Benford and Newcomb stumbled upon the law in the same way: while flipping through pages of a book of logarithmic tables, they noticed that the pages in the beginning of the book were dirtier than the pages at the end. This meant that their colleagues who shared the library preferred quantities beginning with the number one in their various disciplines.
Benford took this observation a step further than Newcomb, and began investigating other groups of numbers, finding that the 鈥渇irst digit law鈥� emerged in groups as disparate as populations, death rates, physical and chemical constants, baseball statistics, the half-lives of radioactive isotopes, answers in a physics book, prime numbers, and Fibonacci numbers. In other words, just about any group of data obtained by using measurements satisfies the law.
On the other hand, data sets that are arbitrary and contain restrictions usually don鈥檛 follow Benford鈥檚 law. For example, lottery numbers, telephone numbers, gas prices, dates, and the weights or heights of a group of people are either random or arbitrarily assigned, and not obtained by measurement.
As Torres and his colleagues explain, scientists in the decades following Benford performed numerous studies, but discovered little more about the law other than racking up a wide variety of examples. However, scientists did discover a few curiosities. For one, when investigating second significant digits of data sets, the law still held, but with less importance. Similarly, for the third and fourth digits, the appearance of the numbers started becoming equal, leveling out at a uniform 10% for the fifth digit. A second discovery attracted even more scientific interest:
鈥淚n 1961, Pinkham discovered the first general relevant result, demonstrating that Benford鈥檚 law is scale invariant and is also the only law referring to digits which can have this scale invariance,鈥� the scientists wrote in their letter. 鈥淭hat is to say, as the length of the rivers of the world in kilometers fulfill Benford鈥檚 law, it is certain that these same data expressed in miles, light years, microns or in any other length units will also fulfill it.鈥�
Torres et al. also explain that in the last years of the 20th century, some important theoretical advances have been proven (base invariance, unicity, etc.), mainly by Ted Hill and other mathematicians. While some cases can be explained (for example, house addresses almost always start with 1鈥檚, and lower numbers must occur before higher numbers), there is still no general justification for all examples. The scientists also explain that there is no a priori criteria that tells when a data set should or should not obey the law.
鈥淣owadays there are many theoretical results about the law, but some points remain in darkness,鈥� said Torres. 鈥淲hy do some numerical sets, like universal physical constants, follow the law so well? We need to know not only mathematical reasons for the law, but also characterize this set of experimental data. For example, what are their points of contact? Where they come from? Apparently, they are independent.
鈥滻 hope the general necessary and sufficient conditions will be discovered in the future鈥攎any people are interested in the law, especially economists鈥攂ut I also know it could be not possible ever,鈥� he added, mentioning Godel.
Nevertheless, scientists have been using the law for many practical applications. For example, because a year鈥檚 accounting data of a company should fulfill the law, economists can detect falsified data, which is very hard to manipulate to follow the law. (Interestingly, scientists found that numbers 5 and 6, rather than 1, are the most prevalent, suggesting that forgers try to 鈥渉ide鈥� data in the middle.)
Benford鈥檚 law has also been recently applied to electoral fraud in order to detect voting anomalies. Scientists found that the 2004 US presidential election showed anomalies in the state of Florida, as well as fraud in Venezuela in 2004 and Mexico in 2006.
鈥淭he story about how it was discovered鈥攖wice鈥攆rom dirty pages 鈥� it is almost incredible,鈥� said Torres. 鈥淏enford's law has undeniable applications, and this useful aspect was not clear when the law was discovered. It seemed to be only a math curiosity. For me, this is an example of how simplicity can be unexpectedly marvelous.鈥�
For more details on Benford鈥檚 law, the highly readable letter is temporarily available at:
(with free registration).
Citation: Torres, J. Fern谩ndez, S., Gamero, A., Solar, A. 鈥淗ow do numbers begin? (The first digit law).鈥� Eur. J. 麻豆淫院. 28 (2007) L17-25.
Copyright 2007 麻豆淫院Org.com.
All rights reserved. This material may not be published, broadcast, rewritten or redistributed in whole or part without the express written permission of 麻豆淫院Org.com.
