3e:null 3f:["$","title",null,{"children":"Linear Regression Mark / Observable Plot | JR | Observable"}] 45:[] 43:{"id":"04d1915c567563ec","slug":null,"title":"Linear Regression Mark / Observable Plot","thumbnail":"18f34078ae05000755520287a01e9d34791188f7826a5d8bbe7d845e13c9547f","access_level":"public","create_time":"$D2023-03-05T07:44:32.350Z","update_time":"$D2023-03-05T10:33:11.102Z","view_time":null,"first_public_time":"$D2023-03-05T07:44:32.350Z","has_unpublished_edits":null,"fork":{"id":"0ee38d9637eb80fc","slug":"plot-linear-regression","title":"Linear Regression Mark / Observable Plot","owner":{"id":"f35c755083683fe5","login":"observablehq","name":"Observable"}},"stars":0,"starred":false,"owner":{"type":"team","id":"b756b2b38e16dec7","login":"jr15","name":"JR","avatar_url":"https://avatars-next.observableusercontent.com/fba3fbbfb4ccec850d4f464fe26ca1861b43dff64a0b0750427d258677281ee7","tier":"starter_2024","bio":"","following":false},"version":349,"publish_version":null,"role":null,"authored":false,"authors":[{"type":"individual","id":"6f607e7d94e2337a","login":"jr15","name":"JR","avatar_url":"https://avatars-next.observableusercontent.com/fba3fbbfb4ccec850d4f464fe26ca1861b43dff64a0b0750427d258677281ee7","tier":null,"bio":"","following":false}],"members":[{"type":"individual","id":"6f607e7d94e2337a","login":"jr15","name":"JR","avatar_url":"https://avatars-next.observableusercontent.com/fba3fbbfb4ccec850d4f464fe26ca1861b43dff64a0b0750427d258677281ee7","tier":null,"role":"editor"}],"comments":[],"custom_thumbnail":false,"trashed":false,"lapsed":null,"subscribed":null,"forks":0,"collection":null,"type":"notebook","body":{"titling":"auto","title":"Linear Regression Mark / Observable Plot","cells":[{"id":72,"value":"

Linear Regression Mark / Observable Plot

Observable Plot › Marks › Linear Regression · API

\n\n# Plot: Linear Regression\n\nRegression methods show trends by creating a mathematical model of how an observation (called the _dependent variable_, typically **y**) depends on a given input (called the _independent variable_, typically **x**). A linear model posits that _y_ is determined by an underlying affine function ${tex`y = a + b x`}, where _a_ is a constant (intercept of the line on the _y_-axis when _x_ = 0) and _b_ is the slope.","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"","database":"$undefined"},{"id":12,"value":"Plot.plot({\n marks: [\n Plot.dot(cars, {x: \"weight (lb)\", y: \"power (hp)\", strokeOpacity: 0.5, r: 2}),\n Plot.linearRegressionY(cars, {x: \"weight (lb)\", y: \"power (hp)\", stroke: \"steelblue\", ci: 0.95})\n ]\n})","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":106,"value":"Given a set of values {*x*, *y*}, the linear regression method returns the most likely parameters _a_ and _b_ for the model, as well as a confidence band showing the range where these parameters lie with a certain probability, called **ci** (for confidence interval), which defaults to 0.95.","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"","database":"$undefined"},{"id":48,"value":"Plot.plot({\n marks: [\n Plot.dot(cars, {x: \"weight (lb)\", y: \"power (hp)\", strokeOpacity: 0.5, r: 2}),\n Plot.dot(cars.slice(0, m), {x: \"weight (lb)\", y: \"power (hp)\", fill: \"steelblue\", r: 2}),\n Plot.linearRegressionY(cars.slice(0, m), {x: \"weight (lb)\", y: \"power (hp)\", stroke: \"steelblue\"})\n ]\n})","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":79,"value":"Use the slider below to build a linear from a subset of the data; as you can see, the model gives a line as soon as two points are available, and gets more refined and stable as the size of the subset increases. When operating on a subset of the data (the “training dataset”, in machine learning parlance), it is usually better to have a wider domain of *x* values, maybe by shuffling the data.","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"","database":"$undefined"},{"id":50,"value":"viewof m = Inputs.range([0, cars.length], {step: 1, label: \"Number of points\"})","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":60,"value":"Plot.plot({\n marks: [\n Plot.dot(cars, {\n x: \"weight (lb)\",\n y: \"power (hp)\",\n strokeOpacity: 0.75,\n r: 2\n }),\n Plot.dot(carsByWeight.slice(0, m), {\n x: \"weight (lb)\",\n y: \"power (hp)\",\n fill: \"#6BCDEC\",\n r: 2\n }),\n Plot.dot(carsByWeight.slice(m), {\n x: \"weight (lb)\",\n y: \"power (hp)\",\n fill: \"#F81F26\",\n r: 2\n }),\n Plot.linearRegressionY(carsByWeight.slice(0, m), {\n x: \"weight (lb)\",\n y: \"power (hp)\",\n stroke: \"#17375E\",\n ci: 0.95\n }),\n Plot.linearRegressionY(carsByWeight.slice(m), {\n x: \"weight (lb)\",\n y: \"power (hp)\",\n stroke: \"#F81F26\",\n ci: 0.95\n })\n ]\n})","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":237,"value":"linearRegression = d3\n .regressionLinear()\n .x((d) => d.x)\n .y((d) => d.y)","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":304,"value":"data_1_x_value[m - 1]","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":325,"value":"pre_period_deviation = {\n if (m < 2) {\n return \"NA\";\n } else if (m > cars.length - 2) {\n return \"NA\";\n } else {\n return \"Yes\";\n }\n}","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":244,"value":"linearRegression(carsByWeight.slice(m))","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":248,"value":"LR = d3.regressionLinear()","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":265,"value":"LR(\n kk.map((d) => d[\"name\"]),\n kk.map((d) => d[\"economy (mpg)\"])\n)","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":271,"value":"carsByWeight[\"name\"]","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":166,"value":"kk = carsByWeight.slice(m)","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":195,"value":"kk.map((d) => d.name)","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":119,"value":"carsByWeight = d3.sort(cars, d => d[\"weight (lb)\"])","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":206,"value":"data_1 = carsByWeight.slice(0, m)","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":208,"value":"data_1_x_value = data_1.map((data_1) => data_1[\"weight (lb)\"])","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":288,"value":"d3.mean(data_1_x_value)","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":204,"value":"data_1_y_value = data_1.map((data_1) => data_1[\"power (hp)\"])","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":330,"value":"d3.quantile(data_1_x_value, 0.25)","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":234,"value":"linearRegression_2 = d3\n .regressionLinear()\n .x((d) => d.x)\n .y((d) => d.y)\n .domain([-1.7, 16])","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":335,"value":"data_1.map((d) => d.name)[0]","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":226,"value":"d3 = require(\"d3-array@3\", \"d3-axis@3\", \"d3-regression@1\", \"d3-scale@4\", \"d3-shape@3\", \"d3-selection@3\")","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":91,"value":"This type of model is regularly criticized for pushing people to the wrong conclusions about their data when the actual underlying structure or process is nonlinear. For example, if you measure the relationship between culmen depth and length in a mixed population of penguins, it is positively correlated in each of the three species (bigger penguins with the longer culmens also tend to have the deeper ones); however, the Gentoo population has a smaller aspect ratio of depth against length, and the overall correlation across the three species is negative. This is called [Simpson’s paradox](https://en.wikipedia.org/wiki/Simpson%27s_paradox), and it applies to any data that contains underlying populations with different properties or outcomes.","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"","database":"$undefined"},{"id":10,"value":"Plot.plot({\n grid: true,\n color: {legend: true},\n marks: [\n Plot.dot(penguins, {x: \"culmen_length_mm\", y: \"culmen_depth_mm\", fill: \"species\"}),\n Plot.linearRegressionY(penguins, {x: \"culmen_length_mm\", y: \"culmen_depth_mm\", stroke: \"species\"}),\n Plot.linearRegressionY(penguins, {x: \"culmen_length_mm\", y: \"culmen_depth_mm\"})\n ]\n})","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":82,"value":"Finally, note that regression is not a symmetric method: the model computed to express _y_ as a function of _x_ (linearRegressionY) doesn’t give the same result as the regression of _x_ as a function of _y_ (linearRegressionX) unless the points are all perfectly aligned. In the worst case, where the two variables are statistically independent, the linear regression of _y_ against _x_ is an horizontal line, whereas the linear regression of _x_ against _y_ is a vertical line.","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"","database":"$undefined"},{"id":69,"value":"Plot.plot({\n marks: [\n Plot.dot(cars, {x: \"weight (lb)\", y: \"power (hp)\", strokeOpacity: 0.5, r: 2}),\n Plot.linearRegressionY(cars, {x: \"weight (lb)\", y: \"power (hp)\", stroke: \"steelblue\"}),\n Plot.linearRegressionX(cars, {x: \"weight (lb)\", y: \"power (hp)\", stroke: \"orange\"})\n ]\n})","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":161,"value":"Next \nAPI Reference","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"","database":"$undefined"},{"id":286,"value":"Plot.plot({\n marks: [\n Plot.linearRegressionY(penguins, {x: \"culmen_length_mm\", y: \"culmen_depth_mm\", stroke: \"species\"})\n ]\n})","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"}],"files":"$W45","stdlib":"1"}} 44:"$43:body"