36:null 37:["$","title",null,{"children":"Benford Distribution | Jose.carmona-sanchez | Observable"}] 3d:T8e2, ### Explanation of Newcomb-Benford Law Newcomb-Benford's (NB) Law states the first digit of numbers in real-life data sets is governed by ${tex`p_i = \log_{10}\left (1 + \frac{1}{i}\right)`} where ${tex`p_i`} is the probability of the digit ${tex`i \in [1...9]`}. The following table shows the expected probability for each digit. | ${tex`i`} | ${tex`p_i`} | |---|----------| | 1 | 0.30103 | | 2 | 0.17609 | | 3 | 0.12494 | | 4 | 0.09691 | | 5 | 0.079181 | | 6 | 0.066947 | | 7 | 0.057992 | | 8 | 0.051153 | | 9 | 0.045757 | This "Law" in data occurs frequently enough that it has been used to test for accounting fraud, government corruption, and the validity of scientific results, such as COVID-19 data. Not all data have this distribution, for NB's law to hold data should: - **have sufficient span** either a complete or several orders of magnitude in the data's span. - **have large enough sample size** random chance could make a few first digits non-NB. If the data set is small enough (say 25 or less), this could have a significant impact on statistical tests for NB distributions. - **be right skewed** often this is associated with some combinatory or self-organized aspect of the data. Right skew generally increases the span, returning us to the first expectation. - **not be human assigned** serial numbers or telephone numbers would not work. Likewise, numbers that have been manipulated by humans to serve some purpose will not work. Identifying such numbers is the point of this exercise. - **not be bound** the data should not have a hard maximum or minimum imposed by the physical setting. For example, daily temperatures are not Benford distributed. One what to think of data having these characteristics is that the data have some underlying, exponential process operating generate it. This would mean that random samples from the data would stretch across orders of magnitude, but be the samples would be evenly distributed across several orders of magnitude. As such, we see why NB's Law emerges from data sets having the above characteristics, by considering logarithmic axes drawn on top of linear axes. Can you see the red lines on the log scale are at exactly the points give by ${tex`p_i = \log_{10}\left (1 + \frac{1}{i}\right)`}?3e:T62b,{ const validRows = purchasesDigit1 .map(row => (typeof row === "object" && row !== null ? Object.values(row)[0] : row)) .map(val => parseInt(String(val)[0])) .filter(d => !isNaN(d) && d >= 1 && d <= 9); const n = validRows.length; const counts = [0, 0, 0, 0, 0, 0, 0, 0, 0]; for (let d of validRows) counts[d - 1]++; let sumSq = 0; for (let i = 0; i < 9; i++) { let pObs = counts[i] / n; let pExp = Benford_distribution[i].rate; let diff = pExp - pObs; sumSq += diff * diff; } const dStar = Math.sqrt(sumSq) / 1.03606; let verdict = ""; if (n <= 30) { verdict = "Inconclusive (N too small)"; } else if (dStar < 0.19) { verdict = "Conforming"; } else { verdict = "Non-Conforming"; } return Plot.plot({ title: "2023 Credit Card Purchases", subtitle: "d* = " + dStar.toFixed(4) + " (N = " + n + ") - " + verdict, y: { grid: true, label: "Rate" }, x: { label: "First digit", domain: [1, 2, 3, 4, 5, 6, 7, 8, 9] }, color: {legend: true, domain: ["Observed", "Benford"], range: ["grey", "black"]}, marks: [ Plot.barY( validRows, Plot.groupX( { y: "proportion" }, { x: Plot.identity, fill: () => "Observed", fillOpacity: 0.6, tip: true } ) ), Plot.dot(Benford_distribution, { x: "digit", y: "rate", fill: () => "Benford", tip: true }), Plot.ruleX(Benford_distribution, { x: "digit", y1: d => d.rate * 0.9, y2: d => d.rate * 1.1, marker: "tick" }), Plot.ruleY([0]) ] }); }3f:T4c8,### Testing for Benford Distributions Give a data set that may be Bedford, the first digits can be evaluated to estimate the probability of each digit's value. Call that data set ${tex`p^\dagger`}. In addition to visual inspection, the ${tex`d^*`} statistic is frequently used ${tex`d^* = \frac{1}{ 1.03606 }\sqrt{ \sum_{i=1}^9 (p_i-p^\dagger_i)^2} `}. Where the denominator is just the maximum difference between Benford distribution of first digits and some data set. This makes ${tex`d^* \in`} [0,1] where ${tex`d^* =`} 0 is maximally Benford and ${tex`d^* =`} 1 is maximally non-Benford. Provided there are sufficient samples, values of ${tex`d^* > `} 0.25 might be considered fraudulent, and values over 0.19 should attract additional scrutiny. However, questions about the span of the data and the number of samples make firm guidelines difficult to state. ### Further reading [An introduction](https://rss.onlinelibrary.wiley.com/doi/pdf/10.1111/j.1740-9713.2016.00919.x) ## Something to try Below I've uploaded a CSV file. It consists of 6 columns of different length. They are all drawn from data you may find interesting. In your groups, develop a method of determining if each column is Bedford distributed. 40:T5be,{ return html`

${Object.keys(mystery[0]).map((letter) => { const validRows = mystery .map((row) => parseInt(String(row[letter])[0])) .filter((d) => !isNaN(d) && d >= 1 && d <= 9); const n = validRows.length; const counts = [0, 0, 0, 0, 0, 0, 0, 0, 0]; for (let d of validRows) counts[d - 1]++; let sumSq = 0; for (let i = 0; i < 9; i++) { let pObs = counts[i] / n; let pExp = Benford_distribution[i].rate; let diff = pExp - pObs; sumSq += diff * diff; } const dStar = Math.sqrt(sumSq) / 1.03606; let verdict = ""; if (n <= 30) { verdict = "Inconclusive (N too small)"; } else if (dStar < 0.19) { verdict = "Conforming"; } else { verdict = "Non-Conforming"; } return Plot.plot({ title: letter + " Column", subtitle: "d* = " + dStar.toFixed(4) + " (N = " + n + ") - " + verdict, y: { grid: true, label: "Rate", domain: [0, 0.5] }, x: { label: "First digit", domain: [1, 2, 3, 4, 5, 6, 7, 8, 9] }, color: {legend: true, domain: ["Observed", "Benford"], range: ["grey", "black"]}, marks: [ Plot.barY( validRows, Plot.groupX( { y: "proportion" }, { x: Plot.identity, fill: () => "Observed", fillOpacity: 0.6, tip: true } ) ), Plot.dot(Benford_distribution, { x: "digit", y: "rate", fill: () => "Benford", tip: true }), Plot.ruleX(Benford_distribution, { x: "digit", y1: (d) => d.rate * 0.9, y2: (d) => d.rate * 1.1, marker: "tick" }), Plot.ruleY([0]) ] }); })} )}

`; }41:[{"id":"0786be72140ead175fb2d952e668c209b605c71350d9dd66b9f0af6ca796b6f7ac0bfde12394fa9e3d1f576ccd606e1772e07e001d2ab1878f452522a16e9784","href":"https://static.observableusercontent.com/files/0786be72140ead175fb2d952e668c209b605c71350d9dd66b9f0af6ca796b6f7ac0bfde12394fa9e3d1f576ccd606e1772e07e001d2ab1878f452522a16e9784","name":"2023 Purchases - digit1.csv","type":"text/csv","lastModified":1729629855746.169,"size":4230},{"id":"82bcda9673e15d725fa2d123ee12ae14f6d4255ce997e832654edcc7f2314c44715b2da3c80115c4158f6eec3f5c9b6321bc23a552a06c5d0fc5f9c39fa2b6e6","href":"https://static.observableusercontent.com/files/82bcda9673e15d725fa2d123ee12ae14f6d4255ce997e832654edcc7f2314c44715b2da3c80115c4158f6eec3f5c9b6321bc23a552a06c5d0fc5f9c39fa2b6e6","name":"Mystery@1.csv","type":"text/csv","lastModified":1729697438749.061,"size":5297},{"id":"1ea3becf1fc8c04b5f8112e519f0fd4c02303756a02034878e7db7d4438e52a3f00666482b7a9f637670b130dbbf383f3cd0ccb7a6d83e4fb00c4c8b2ebb8669","href":"https://static.observableusercontent.com/files/1ea3becf1fc8c04b5f8112e519f0fd4c02303756a02034878e7db7d4438e52a3f00666482b7a9f637670b130dbbf383f3cd0ccb7a6d83e4fb00c4c8b2ebb8669","name":"Mystery.csv","type":"text/csv","lastModified":1729696759901.689,"size":26226}] 3b:{"id":"2c0891ad446fb535","slug":"benford-distribution/2","title":"Benford Distribution","thumbnail":"cd44bed5b708153ca5b7d6e9befea355e91bc685a120c1c752fed8cc25aac2d4","access_level":"public","create_time":"$D2026-09-16T17:42:24.719Z","update_time":"$D2026-09-16T18:03:15.056Z","view_time":null,"first_public_time":"$D2026-09-16T18:02:26.363Z","has_unpublished_edits":null,"fork":{"id":"7fc4204f9ad802e0","slug":"benford-distribution","title":"Benford Distribution","owner":{"id":"dff9b5e6e979adb0","login":"dlw272","name":"Dusty Wolfe Synek"}},"stars":0,"starred":false,"owner":{"type":"team","id":"6e1a0b6a59a98d7d","login":"jose-carmona-sanchez","name":"Jose.carmona-sanchez","avatar_url":"https://avatars-next.observableusercontent.com/7c7c926efd11da0bb4d75ebd1a0198795094c32af03dd95ecac6eebd7c4f7fb5","tier":"starter_2024","bio":"","following":false},"version":601,"publish_version":601,"role":null,"authored":false,"authors":[{"type":"individual","id":"ef578cb74e81811e","login":"jose-carmona-sanchez","name":"Jose.carmona-sanchez","avatar_url":"https://avatars-next.observableusercontent.com/7c7c926efd11da0bb4d75ebd1a0198795094c32af03dd95ecac6eebd7c4f7fb5","tier":null,"bio":"","following":false}],"members":[{"type":"team","id":"6e1a0b6a59a98d7d","login":"jose-carmona-sanchez","name":"Jose.carmona-sanchez","avatar_url":"https://avatars-next.observableusercontent.com/7c7c926efd11da0bb4d75ebd1a0198795094c32af03dd95ecac6eebd7c4f7fb5","tier":"starter_2024","role":"editor"}],"comments":[],"custom_thumbnail":false,"trashed":false,"lapsed":null,"subscribed":null,"forks":0,"collection":null,"type":"notebook","body":{"titling":"auto","title":"Benford Distribution","cells":[{"id":0,"value":"# Benford Distribution\n### Jose, Gram, Dusty\nThe objective of this in-class exercise is to visually compare the first digit frequencies of a set of randomly generated data to the Benford distribution. In groups, you will work to achieve the most informative and easily understood visualization possible.","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"","database":"$undefined"},{"id":272,"value":"$3d","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"","database":"$undefined"},{"id":274,"value":"Plot.plot({\n x: { type: \"log\", domain: [1, 10], grid: true }\n})","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":278,"value":"Plot.plot({\n x: {\n type: \"linear\",\n domain: [0, 1],\n grid: true\n },\n marks: [\n Plot.ruleX(\n d3\n .range(1, 10)\n .map((x) => Math.log10(1 + 1 / x))\n .map(\n (\n (sum) => (value) =>\n (sum += value)\n )(0)\n ),\n { stroke: \"red\" }\n )\n ]\n})","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":301,"value":"## Assignment\nBased on your understanding of the Newcomb-Benford law develop quantitative and graphical methods for testing a set of numbers for NB. Your graphs should do two things: 1) show the distribution of first digits in relation to the values anticipated by NB. 2) provide a single, scalar valued statistical summary of the differences.\n\nSee below for a formula for the statistical summary.\n\nI've provided some conveniences variables below, as javascript.\n* `Benford_distribution` provides the first digit probabilities for the distribution.\n* `Random_distribution` provides a random distribution of first digits.\n* `bins` counts how many of those randomly sampled first digits are each of the nine digits.\n\nThe visual your group creates should show the Benford predictions and the results of the random sampled numbers. Fork this page and get going!\n\n*** You are on your honor to not look at the other forks! I want to see original ideas for how to do this. ***","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":319,"value":"dStar = {\n const n = random_distribution.length;\n const counts = Array(9).fill(0);\n for (const d of random_distribution) {\n const val = typeof d === \"object\" ? d.value : d;\n if (val >= 1 && val <= 9) counts[val - 1]++;\n }\n const proportions = counts.map(c => c / n);\n\n const sumSqDiff = proportions.reduce((sum, pObs, i) => {\n return sum + Math.pow(Benford_distribution[i].rate - pObs, 2);\n }, 0);\n\n return Math.sqrt(sumSqDiff) / 1.03606;\n}","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":309,"value":"Plot.plot({\n title: \"Benford Graph\",\n y: {grid: true, label: \"Rate\"},\n x: {label: \"First digit\"},\n color: {legend: true, domain: [\"Observed\", \"Benford\"], range: [\"grey\", \"black\"]},\n marks: [\n Plot.barY(random_distribution, Plot.groupX({y: \"proportion\"}, {x: \"value\", fill: () => \"Observed\", fillOpacity: 0.6})),\n Plot.ruleX(Benford_distribution, {x: \"digit\", y1: (d) => d.rate*0.9, y2: (d) => d.rate* 1.1, marker: \"tick\"}),\n Plot.dot(Benford_distribution, {x: \"digit\", y: \"rate\", fill: () => \"Benford\",tip:true}),\n Plot.ruleY([0])\n ]\n})","pinned":true,"hidden":false,"mode":"ts","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":5,"value":"Benford_distribution = d3\n .range(1, 10)\n .map((x) => ({ digit: x, rate: Math.log10(1 + 1 / x) }))","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":290,"value":"// This is the number of samples that will be used to compute randomly generated Benford distributions see how many samples you need to get really good vs somewhat noisy distributions.\nnumber_of_samples = 100000","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":292,"value":"// This is the number of orders of magnitude the random_distribution is over. See how 'Benford' this is for shorter spans vs longer ones\nspan = 5","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":47,"value":"random_distribution = d3.range(number_of_samples).map((x) => ({\n sample: x,\n value: parseInt(Math.pow(10, d3.randomUniform().call() * span).toString()[0])\n}))","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":51,"value":"function getFirstDigit(x) {\n // Note this wont work if x < 1\n return parseInt(x.toString()[0]);\n}","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":137,"value":"bins = d3\n .bin()\n .thresholds(9)\n .value((d) => d.value)(random_distribution)","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":264,"value":"## Test Data\nBelow I've uploaded the first digit of all of my 2023 credit card purchases. What do you think? Benford? Try it out! Use the plot technique you developed above.","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"","database":"$undefined"},{"id":330,"value":"$3e","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":261,"value":"purchasesDigit1 = await FileAttachment(\"2023 Purchases - digit1.csv\").csv({typed: \"auto\"})","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"purchasesDigit1","database":"$undefined"},{"id":298,"value":"purchasesDigit1[0].digit_1","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":287,"value":"$3f","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"","database":"$undefined"},{"id":296,"value":"mystery = await FileAttachment(\"Mystery@1.csv\").csv({typed: \"auto\"})","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"mystery","database":"$undefined"},{"id":317,"value":"// How to access columns: mystery.map(d => d.A)\n\n// Plot.auto(mystery, {x: mystery.map(d => d.A)}).plot()\n// mystery.map(d => getFirstDigit(99) ) // All NaN. For some reason Jesse's function doesn't work here.\n\n// mystery.map( row => parseInt(row.A.toString()[0]) )\n// Object.keys(mystery[0]).map( letter => mystery.map( row => parseInt(row.letter.toString()[0]) ) )\n\n/*\nObject.keys(mystery[0]).map(\n letter => ({\n [letter]: mystery.map(\n row => parseInt(row[letter].toString()[0])\n )})\n)\n*/\n\n// from entries takes an object [a, b] and produces {a: 'b'}\nfiltered_data = Object.fromEntries(\n Object.keys(mystery[0]).map(letter =>\n [letter, mystery.map(row => parseInt(row[letter].toString()[0])).filter( num => Number.isInteger(num))\n\n // Generates the column of a letter given a letter\n ]\n )\n)","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":318,"value":"$40","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"}],"files":"$W41","stdlib":"1"}} 3c:"$3b:body"