2b:null 2c:["$","title",null,{"children":"Assignment (Data science workflows in JavaScript Workshop Series) | Jorge Rivera | Observable"}] 31:T435,For this assignment, you will explore impacts of calcium addition on sugar maple seedlings in two watersheds at Hubbard Brook Experimental Forest using data from Juice and Fahey (2019). Sugar maple (_Acer saccharum_) growth can be inhibited by soil acidification from acid rain, which leaches calcium (a nutrient important for plant growth) from soils. Learn more: [Decades of acid rain is causing loss of valuable Northeast sugar maples, Cornell researchers warn](https://news.cornell.edu/stories/2006/05/acid-rain-causing-decline-sugar-maples-say-researchers). Stephanie Juice, Tim Fahey and colleagues at Hubbard Brook Long Term Ecological Research (LTER) site (Vermont, USA) measured “general sugar maple germinant health by height, leaf area, biomass, and chlorophyll content” (Juice and Fahey 2019) for seedlings in untreated and calcium-treated watersheds to investigate the impact of soil calcium addition on sugar maple seedling growth. In this assignment, you will explore the sugar maple data to gain insights about the impact of watershed calcium addition.32:[] 2f:{"id":"7d4f04e45e0b2a94","slug":null,"title":"Assignment (Data science workflows in JavaScript Workshop Series)","thumbnail":"49e3b8e7b5c25c76853ac31b4ed41e895e2facb91573182f4e68e995d0ccb899","access_level":"public","create_time":"$D2023-07-26T06:23:30.584Z","update_time":"$D2023-07-30T14:53:16.382Z","view_time":null,"first_public_time":"$D2023-07-26T06:23:30.584Z","fork":true,"stars":0,"starred":false,"owner":{"type":"team","id":"6f4e48a30033cb71","login":"jm-rivera","name":"Jorge Rivera","avatar_url":"https://avatars-next.observableusercontent.com/eb9ffa1c5d630f63517176ded24be11e0764d4d4e52d473aa882a19f73422911","tier":"starter_2024"},"version":602,"publish_version":null,"role":null,"authored":false,"authors":[{"type":"individual","id":"0004d5be12d25201","login":"jm-rivera","name":"Jorge Rivera","avatar_url":"https://avatars-next.observableusercontent.com/eb9ffa1c5d630f63517176ded24be11e0764d4d4e52d473aa882a19f73422911","tier":null}],"members":[{"type":"individual","id":"0004d5be12d25201","login":"jm-rivera","name":"Jorge Rivera","avatar_url":"https://avatars-next.observableusercontent.com/eb9ffa1c5d630f63517176ded24be11e0764d4d4e52d473aa882a19f73422911","tier":null,"role":"editor"}],"comments":[],"custom_thumbnail":false,"trashed":false,"lapsed":null,"subscribed":null,"forks":0,"collection":null,"type":"notebook","body":{"title":"Assignment (Data science workflows in JavaScript Workshop Series)","cells":[{"id":0,"value":"# Assignment (Data science workflows in JavaScript Workshop Series)","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":5,"value":"## Logistics\n\n- **Fork this notebook** to make your own copy. Complete tasks below in your fork.\n- When you are ready to submit, ensure that your fork visibility is **Public unlisted** so that we can see your work. To update the setting, go to the Share button, the under Access choose “Can view (unlisted)” for Public visibility. Make sure to Save changes.\n- Submit assignment by sharing the URL in [this Google Form](https://forms.gle/cYLwZBsyvikVwgH59) by end of day **Friday, August 4th 2023**\n- Ask questions in the Observable Community Slack #learn-javascript channel.\n- Things in yellow are where you’re prompted to add content for the assignment.","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":27,"value":"## About the data","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":29,"value":"$31","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":33,"value":"**Data source:** Juice, S. and T. Fahey. 2019. Health and mycorrhizal colonization response of sugar maple (Acer saccharum) seedlings to calcium addition in Watershed 1 at the Hubbard Brook Experimental Forest ver 3. Environmental Data Initiative. https://doi.org/10.6073/pasta/0ade53ede9a916a36962799b2407097e","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":43,"value":"## Task 1: Access the data","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":45,"value":"Access the data from the [this data package on the Environmental Data Initiative](https://portal.edirepository.org/nis/mapbrowse?packageid=knb-lter-hbr.157.3). You will only need one file: **w1_acsa_seed_physical** (found in the Resources section on that page). You can either read in the remote file directly using the URL, or download the file and attach it in your notebook. Note that while this is a text file (.txt), values are comma-separated, so you can still use the CSV methods we used in the workshop.","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":58,"value":"Below this cell, add a new JavaScript cell below, then add code to load data from the file above as `maples`.","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":451,"value":"maples = d3.csv(\n \"https://portal.edirepository.org/nis/dataviewer?packageid=knb-lter-hbr.157.3&entityid=5c415a399b00430d35d13c31312f1e53\",\n d3.autoType\n)","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","output":"$undefined","database":"$undefined"},{"id":66,"value":"---\n## Task 2: Take a look at the data in a Data table cell","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":74,"value":"Below, visualize the `maples` data in a Data table cell. Familiarize yourself with the variables. Here are variable summaries (for the variables you’ll use in this assignment) from the [data package metadata](https://portal.edirepository.org/nis/metadataviewer?packageid=knb-lter-hbr.157.3): \n\n- **Year**: year measured\n- **Watershed**: study watershed (Reference = untreated; W1 = Calcium treated)\n- **Elevation**: categorical description of watershed elevation\n- **Transect**: study transect\n- **Sample**: sugar maple seedling sample number\n- **StemLength**: seedling stem length (millimeters)\n- **Leaf1Area**: area of first leaf sampled from seedling (cm²)\n- **Leaf2Area**: area of second leaf sampled from seedling (cm²)\n- **LeafDryMass**: dry mass of both leaves (grams)\n- **StemDryMass**: dry mass of seedling stem (grams)\n- **CorrectedLeafArea**: total leaf area for both sampled leaves (Leaf1Area + Leaf2Area), corrected for the area removed for chlorophyll analysis (cm²)","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":93,"value":"Below this cell, add a new Data table cell below, selecting maples as the data source:","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":456,"value":"maplesTable = maples","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","output":"maplesTable","database":"$undefined"},{"id":97,"value":"---\n## Task 3: Data wrangling","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":99,"value":"Make a simplified version of the `maples` data that only includes observations from 2003. Using the method(s) of your choice (e.g. Array methods, Arquero, SQL, Data table cell, any other tools you prefer, or a combination!), create a simplified version of the `maples` data updated as follows:\n\n- Only keep (and rename) variables:\n - Year (rename to **year**)\n - Watershed (rename to **watershed**)\n - StemLength (rename to **stemLength**)\n - LeafDryMass (rename to **leafMass**)\n - StemDryMass (rename to **stemMass**)\n - CorrectedLeafArea (rename to **leafArea**)\n- Only keep observations from 2003","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":105,"value":"Below this cell, add a JavaScript, SQL, or Data Table cell to wrangle the data as described above, naming your new subset `maples2003`.","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":459,"value":"maples2003 = maples\n .map((d) => ({\n year: d.Year,\n watershed: d.Watershed,\n stemLength: d.StemLength,\n leafMass: d.LeafDryMass,\n stemMass: d.StemDryMass,\n leafArea: d.CorrectedLeafArea\n }))\n .filter((d) => d.year == 2003)","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","output":"$undefined","database":"$undefined"},{"id":127,"value":"---\n## Task 4: Exploratory data visualization","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":129,"value":"In the area below, create three exploratory data visualizations for the 2003 maple seedlings. Where prompted, add a Markdown cell with a 1-sentences summary of a takeaway or insight gleaned from the visualization.\n\n**Note:** Throughout the rest of the assignment, you will use the 2003 subset `maples2003` you created above.","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":131,"value":"Below this cell, use the **Chart cell** to create histogram of leafArea for seedlings recorded in 2003. Facet (vertically) by watershed to compare the distributions in the untreated (Reference) and calcium treated (W1) watersheds. ","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":472,"value":"maples2003Histogram = Plot.plot({\n color: {\n legend: true\n },\n marks: [\n Plot.auto(maples2003, {x: \"leafArea\", fy: \"watershed\", color: \"watershed\"})\n ]\n})","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","output":"maples2003Histogram","database":"$undefined"},{"id":210,"value":"Below this cell, add a new Markdown cell, then describe and compare the distributions for leaf areas in untreated and calcium treated watersheds based on the histograms.","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":478,"value":"Untreated watersheds have a lower leafArea overall, compared to calcium-treated ones. Untreated have leaf areas concentrated around 15-30cm2, whereas there's a bigger spread for the treated, which tends towards 25-40cm2","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":181,"value":"---","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":183,"value":"Below this cell, insert a **Plot snippet from the Add cell menu to create a Scatterplot** of **stemLength** and **stemMass**, with fill color mapped to **watershed**. Then, visualize the linear trends by adding a `linearRegressionY` mark atop the scatterplot mark, with stroke color mapped to **watershed**.","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":481,"value":"Plot.plot({\n marks: [\n Plot.dot(maples2003, {\n x: \"stemLength\",\n y: \"stemMass\",\n fill: \"watershed\",\n tip: true\n }),\n Plot.linearRegressionY(maples2003, {\n x: \"stemLength\",\n y: \"stemMass\",\n stroke: \"watershed\"\n })\n ]\n})","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","output":"$undefined","database":"$undefined"},{"id":219,"value":"Below this cell, add a new Markdown cell, then describe and compare the relationship between stem length and mass in untreated and calcium treated watersheds.","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":492,"value":"There's an overall positive relationship between stem length and stem mass. When looking this relationship by watershed we see that this relationship appears to be slightly more positive on the treated watershed, and that it yields both overall higher stem mass and stem length, when compared to untreated.","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":198,"value":"---\nBelow this cell, add a JavaScript cell to import PlotMatrix from [Fil’s Autoplot matrix notebook](https://observablehq.com/@observablehq/autoplot-matrix). Then in a second JavaScript cell, use PlotMatrix to create an interactive matrix of charts to visualize the different variable relationships and distributions.","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":498,"value":"import { PlotMatrix } with { maples2003 as data } from \"@observablehq/autoplot-matrix\"","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","output":"$undefined","database":"$undefined"},{"id":501,"value":"PlotMatrix(maples2003)","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","output":"$undefined","database":"$undefined"},{"id":204,"value":"---\n## Task 5: Analysis / modeling","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":228,"value":"**Choose one** of the following to explore differences and patterns in sugar maple morphology in untreated and calcium-treated watersheds: \n\n- **Option 1:** Perform simple linear regression on stem dimensions (stemLength versus stemMass) for the untreated and calcium-amended watershed. For the purposes of this assignment, you can do these separately (e.g. create separate subsets for Reference and W1 watersheds, then use simple linear regression to estimate parameters for each). \n\n- **Option 2:** Perform k-means clustering with two clusters to see if, based on the four quantitative variables in `maples2003`, the seedlings are largely within separate clusters based on watershed. Add a visualization or table to describe the outcomes of cluster analysis.\n \n- **Option 3:** Perform principal component analysis using the four quantitative variables in `maples2003`, and create a biplot showing both observation scores (points) on PC1 and PC2, overlayed by the variable vectors (arrows).\n","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":237,"value":"Below this cell, add any cells necessary to perform the analysis you chose from the options above.","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":515,"value":"### Import required libraries","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":504,"value":"ML = require(\"https://www.lactame.com/lib/ml/6.0.0/ml.min.js\")","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","output":"$undefined","database":"$undefined"},{"id":506,"value":"import { scale, asMatrix } from \"@chrispahm/hierarchical-clustering\"","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","output":"$undefined","database":"$undefined"},{"id":541,"value":"import { viewof scores } with {\n maples2003Scaled as food_scaled,\n maples2003 as food\n} from \"@chrispahm/principal-component-analysis\"","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","output":"$undefined","database":"$undefined"},{"id":563,"value":"import { viewof loadings } with { maples2003Scaled as food_scaled } from \"@chrispahm/principal-component-analysis\"","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","output":"$undefined","database":"$undefined"},{"id":517,"value":"### Get a scaled array of the original data (only features)","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":508,"value":"maples2003Scaled = scale(maples2003.map(({ year, watershed, ...rest }) => rest))","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","output":"$undefined","database":"$undefined"},{"id":519,"value":"### Run PCA","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":513,"value":"maples20003PCA = new ML.PCA(maples2003Scaled.map(Object.values))","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","output":"$undefined","database":"$undefined"},{"id":526,"value":"### Analyse PCA","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":528,"value":"Explained variance by PC (cumulative). PC1 explains 61% of the variance and, together, the first 2 components explain 85% of the variance.","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":536,"value":"cumulativeVarience = maples20003PCA.getCumulativeVariance()","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","output":"$undefined","database":"$undefined"},{"id":543,"value":"Show the loadings table","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":565,"value":"viewof loadings","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","output":"$undefined","database":"$undefined"},{"id":572,"value":"View scores","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":544,"value":"viewof scores","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","output":"$undefined","database":"$undefined"},{"id":549,"value":"scoresCombined = scores.map((d, i) => ({\n ...d,\n year: maples2003[i].year,\n watershed: maples2003[i].watershed\n}))","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","output":"$undefined","database":"$undefined"},{"id":556,"value":"scalingFactor = 6","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","output":"$undefined","database":"$undefined"},{"id":554,"value":"Plot.plot({\n marks: [\n Plot.dot(scoresCombined, {\n x: \"PC1\",\n y: \"PC2\",\n fill: \"watershed\",\n r: 4,\n opacity: 0.85,\n stroke: \"black\",\n strokeOpacity: 0.8,\n tip: true\n }),\n Plot.arrow(loadings, {\n x1: 0,\n x2: (d) => d.PC1 * scalingFactor,\n y1: 0,\n y2: (d) => d.PC2 * scalingFactor\n }),\n Plot.text(loadings, {\n x: (d) => d.PC1 * scalingFactor,\n y: (d) => d.PC2 * scalingFactor,\n text: \"Variable\",\n dy: -5,\n dx: 30,\n fill: \"black\",\n stroke: \"white\"\n })\n ],\n color: { legend: true }\n})","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","output":"$undefined","database":"$undefined"},{"id":242,"value":"--- \n","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":244,"value":"Below this cell, add a new Markdown cell and in 1-2 sentences summarize the findings from your analysis for Task 5. Then, in 1-2 sentences based on **all** of the exploration you have done in this assignment, share your preliminary thoughts on if and how calcium addition impacts sugar maple seedlings. ","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":594,"value":"Adding calcium to the watershed of maple seedlings appears to have **a clear impact** on different properties of the sugar maple seedlings. Overall, seedlings show **higher** stem and leaf _length_ and **higher** steam and leaf _mass_, compared to untreated watersheds.\n\nWhile this analysis could benefit from a more thorough consideration of outliers, we can see that calcium seems to play **a greater role in increased leaf area and stem mass** (which are themselves closely related)","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":246,"value":"---\n## Congratulations! Submit your assignment.\n\nOnce you’re done with the assignment, make sure to: \n\n- Update your notebook settings (click the Share button) so that Public access is “View (unlisted)”\n- Submit the URL to your notebook in [this Google form](https://forms.gle/cYLwZBsyvikVwgH59) by midnight on August 4, 2023\n- Await your course certificate, which we’ll send out in mid-August! \n","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"},{"id":262,"value":"_**Thank you** for joining us for the Data Science Workflows in JavaScript workshop series! We look forward to seeing you in our upcoming courses and workshops, and in our Community Slack!_ ","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","output":"","database":"$undefined"}],"files":"$W32","stdlib":"1","titling":"auto"}} 30:"$2f:body"