2a:null 2b:["$","title",null,{"children":"Finding Recent Additions to Code.nasa.gov | Justin Gosses | Observable"}] 30:[] 2e:{"id":"42bd01a27e9ccfac","slug":"finding-recent-additions-to-code-nasa-gov","title":"Finding Recent Additions to Code.nasa.gov","thumbnail":"5c2739a5975aab9a4742d5dfb80f77abedb0ac3c1ada35a84d260f90fa0b97cb","access_level":"public","create_time":"$D2019-09-20T17:19:37.426Z","update_time":"$D2021-06-10T21:40:34.738Z","view_time":null,"first_public_time":"$D2019-09-20T22:23:38.909Z","fork":false,"stars":1,"starred":false,"owner":{"type":"team","id":"3168f49a68f07e98","login":"justingosses","name":"Justin Gosses","avatar_url":"https://avatars-next.observableusercontent.com/eba66f9b9de3134c0c22c453a1d562b450a8cf7f2274c4ed1ff16b7455312520","tier":"starter_2024"},"version":351,"publish_version":351,"role":null,"authored":false,"authors":[{"type":"individual","id":"44bc5e36abcab180","login":"justingosses","name":"Justin Gosses","avatar_url":"https://avatars-next.observableusercontent.com/eba66f9b9de3134c0c22c453a1d562b450a8cf7f2274c4ed1ff16b7455312520","tier":null}],"members":[{"type":"individual","id":"44bc5e36abcab180","login":"justingosses","name":"Justin Gosses","avatar_url":"https://avatars-next.observableusercontent.com/eba66f9b9de3134c0c22c453a1d562b450a8cf7f2274c4ed1ff16b7455312520","tier":null,"role":"editor"}],"comments":[],"custom_thumbnail":false,"trashed":false,"subscribed":null,"forks":6,"collection":{"id":"b7c4119163229a19","slug":"nasa","title":"NASA (mostly forks so go to original)","owner":{"id":"3168f49a68f07e98","login":"justingosses","name":"Justin Gosses"}},"type":"notebook","body":{"title":"Finding Recent Additions to Code.nasa.gov","cells":[{"id":0,"value":"text_1 = md`# Finding Recent Additions to Code.nasa.gov`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":5,"value":"text_2 = html `

This notebook was created as an alternative way to look at the newest code.nasa.gov projects by leveraging the fact that all code project informatin is stored in a JSON.

`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":7,"value":"text_3 = html `

Websites that contain NASA Open-Source Code

`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":9,"value":"text_4 = html`

There are a couple different places you can find lists of NASA open-source code.

`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":12,"value":"text_5 = html`

The website that attempts to be the larger collection across the whole agency and only lists open-source is Code.NASA.Gov

`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":13,"value":"text_7 = html`

If you work in the federal government or inside NASA and would like to also see some closed or government source only code, you should check out software.nasa.gov as well

`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":15,"value":"html `

JSONs that contain information on open-source NASA code

`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":25,"value":"text_8 = html`

This JSON: https://raw.githubusercontent.com/nasa/Open-Source-Catalog/master/code.json is harvested by code.gov. It contains the NASA open-source (and government-source) code projects metadata that you can find on their site. We also harvest this JSON into code.nasa.gov where it is transformed slightly into catalog.json and as raw project data to build code.nasa.gov.

`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":28,"value":"text_9 = html`

Catalog.json is used to build code.nasa.gov. You can find the code repository to build code.nasa.gov here. Please submit an issue if you find any problems.

`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":216,"value":"text_10 = html `

Why have both code.json and catalog.json?

Catalog.json is basically code.json with some formatting changed, A.I. tags added, and only contains open-source code with government-only-source code excluded - which is what we need to build code.nasa.gov

`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":169,"value":"text_12 = md `-----------------------------------------`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":39,"value":"header_2 = md `## Getting the JSONs`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":31,"value":"codejson = d3.json('https://raw.githubusercontent.com/nasa/Open-Source-Catalog/master/code.json')","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":348,"value":"header_table_code_dot_json = html `

Table of Code.json

`","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":325,"value":"table_code_dot_json = Inputs.Table(codejson.releases)","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":32,"value":"catalogjson0 = d3.json('https://raw.githubusercontent.com/nasa/code-nasa-gov/master/data/catalog.json')","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":349,"value":"header_table_catalog_dot_json = html `

Table of Catalog.json

`","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":248,"value":"table_catalog_dot_json = Inputs.Table(catalogjson0)","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":256,"value":"// Plot.dot(catalogjson0, {x: \"Update_Date\", y: \"Labor_Hours\", title: \"species\"}).plot()","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":318,"value":"header_code_projects_by_center_over_time = html `

Code Projects by Center Over Time

`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":279,"value":"plot_code_projects_by_center_over_time = Plot.dot(catalogjson0, {y: \"NASA Center\", x: \"Update_Date\", stroke: \"NASA Center\"}).plot()","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":166,"value":"md `-----------------------------------------`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":119,"value":"md `## Filtering them to only certain projects by Licensing AND/OR Update Date`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":41,"value":"md `### Select Source Type`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":85,"value":"viewof source = radio({\n title: 'License Type',\n description: 'Code on code.json is both source type, code on catalog.json is open-source only!',\n options: [\n { label: 'open-source', value: 'openSource' },\n { label: 'government-source', value: 'governmentWideReuse' },\n { label: 'both', value: 'both'},\n ],\n value: 'both'\n})","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":44,"value":"md `### Select Metadata Changed Date`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":62,"value":"viewof date_proj_added_after = date({\n // title: \"filter to projects added after date\", \n min: \"2000-01-01\",\n max: \"2060-12-31\",\n value: \"2010-01-15\",\n description: \"This filters code projects to only those after this date\"\n})","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":162,"value":"md `-----------------------------------------`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":46,"value":"md `## Results From Filter Selections`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":300,"value":"text_total_tags = html `

The filters above have been selected to filter the code.json file such that only code projects of License Type ${source} that have been added or updated since ${date_proj_added_after}. This amounts to ${codejson_filter_by_date_and_source.length} code projects in total.

`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":313,"value":"table_selected_projects = Inputs.Table(codejson_filter_by_date_and_source)","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":205,"value":"codejson_filter_by_date_and_source","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":231,"value":"header_download_button = html `

Download the Code Projects Since Date Selected With Selected License Type

`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":233,"value":"download_button = createJsonDownloadButton({name: 'codejson_filter_by_date_and_source', results: codejson_filter_by_date_and_source}, 'codejson_filter_by_date_and_source.json', 'Download codejson_filter_by_date_and_source as JSON')","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":331,"value":"html `

`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":243,"value":"html `Other intermediate products`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":109,"value":"md `#### code.json filtered by date and/or source`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":71,"value":"codejson_array = getReleasesFromCodeJSON(codejson)","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":98,"value":"codejson_filter_by_source_only = filterCodeJSONBySource(codejson_array,source)","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":80,"value":"codejson_filter_by_date = filterCodeJSONByDate(codejson,date_proj_added_after)","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":103,"value":"codejson_filter_by_date_and_source = filterCodeJSONBySource(codejson_filter_by_date,source)","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":128,"value":"md `#### catalog.json filtered by date and/or source`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":130,"value":"catalog_array = catalogjson0","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":138,"value":"catalog_array_filter_by_source = filterCatalogBySource(catalog_array,source)","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":144,"value":"catalog_array_filter_by_date = filterCatalogByDate(catalog_array,date_proj_added_after)","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":150,"value":"catalog_array_filter_by_date_and_source = filterCatalogByDate(catalog_array_filter_by_source,date_proj_added_after)","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":237,"value":"function createJsonDownloadButton(data, filename = 'data.json', buttonTitle = 'Download JSON') {\n const blob = new Blob([JSON.stringify(data, null, 2)], {type: \"text/json\"});\n return DOM.download(blob, filename, buttonTitle);\n}","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":189,"value":"md `-----------------------------------------`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":158,"value":"md `NOTE: Currently, catalog.json is updated from code.json manually when code.nasa.gov is re-built. It is common for code.json to have slightly more repositories. If you're harvesting code projects, you'll most likely want to use the code.json!`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":192,"value":"md `Just to re-iterate, catalog.json (and code.nasa.gov) does not have government source code, so it has less code projects than code.json!`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":186,"value":"md `-----------------------------------------`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":54,"value":"md `## Functions Used`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":141,"value":"function filterCatalogByDate(catalog_array,date){\n return catalog_array.filter(catalog_array => catalog_array[\"Update_Date\"] > date);\n}","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":134,"value":"function filterCatalogBySource(catalog_array){\n if (source == \"both\" || source == \"openSource\"){return catalog_array}\n else{\n return []\n }\n}","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":55,"value":"function limitCatalogJsonByDate(catalog){\n var catalog_new = []\n for (var i=0; i< catalog.length; i++){\n // if(new Date(catalog[i][\"Update_Date\"]) <= new Date(date_proj_added_after)){\n if(catalog[i][\"Update_Date\"] >= date_proj_added_after){\n catalog_new.push(catalog[i])\n }\n }\n return catalog_new\n}","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":68,"value":"function getReleasesFromCodeJSON(code_json){\n return code_json[\"releases\"]\n}","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":75,"value":"function filterCodeJSONByDate(codejson,date){\n return codejson_array.filter(codejson_array => codejson_array[\"date\"][\"metadataLastUpdated\"] > date);\n}","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":93,"value":"function filterCodeJSONBySource(code_json_array,source){\n if (source == \"both\"){return code_json_array}\n else{\n return code_json_array.filter(code_json_array => code_json_array[\"permissions\"][\"usageType\"] == source)\n }\n}","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":182,"value":"md `-----------------------------------------`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":35,"value":"md `## IMPORTS`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":246,"value":"Inputs = require(\"@observablehq/inputs@0.7\")","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":4,"value":"d3 = require(\"d3@5\")","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":83,"value":"import {radio} from \"@jashkenas/inputs\"","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":64,"value":"import {date} from \"@jashkenas/inputs\"","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"},{"id":260,"value":"Plot = require(\"@observablehq/plot@0.1\")","pinned":true,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined"}],"files":"$W30","stdlib":"1","titling":"auto"}} 2f:"$2e:body"