2e:null 2f:["$","title",null,{"children":"Doodle recognition with TensorFlow.js | Xari | Observable"}] 34:T53c,md`# Doodle recognition with TensorFlow.js My colleague, Fred, and I lead a workshop at the Applied Machine Learning Days this year for 22 attendees during the weekend session. The goal of the workshop was to teach data scientists the basics of working with TensorFlow and the TensorFlow.js API. After first going through how to build and train a model using TensorFlow in a Jupyter notebook, we switched over to an Observable notebook, where we integrated TFJS, and used our new model to build a prediction interface. We used Google's Quick-Draw dataset to train our model, and we constructed our own drawable \`\`canvas\`\` element on which we drew our doodles. Finally, we assigned the attendees two tasks: * Build an HTML table that displays the predictions for each class * Create a bar-chart of the predictions using D3 Here's a preview of the doodles from the dataset. We didn't use the full dataset though; we trained our model to only detect 15 of the 345 classes in the dataset.`35:T425,html`This cell contains the font-imports and CSS for this notebook. `36:[] 32:{"id":"4795ed67a8c2f708","slug":"doodle-recognition-with-tensorflow-js","title":"Doodle recognition with TensorFlow.js","thumbnail":"6193d593d0d8488a08447d790d748b21b1d9dca554caa656afb476e9d037595c","access_level":"public","create_time":"$D2019-01-10T08:47:42.540Z","update_time":"$D2020-10-15T14:23:49.707Z","view_time":null,"first_public_time":"$D2019-01-22T09:44:58.078Z","has_unpublished_edits":null,"fork":false,"stars":6,"starred":false,"owner":{"type":"team","id":"22a1a1f52c9eee5b","login":"xaris","name":"Xari","avatar_url":"https://avatars-next.observableusercontent.com/6a79baea2b1a1f8cbf7fc9fd58b7a67b61b9ed43b4ecb7aa2cbd3c41df7b533d","tier":"starter_2024"},"version":1761,"publish_version":1761,"role":null,"authored":false,"authors":[{"type":"individual","id":"df040f15107d8f40","login":"xaris","name":"Xari","avatar_url":"https://avatars-next.observableusercontent.com/6a79baea2b1a1f8cbf7fc9fd58b7a67b61b9ed43b4ecb7aa2cbd3c41df7b533d","tier":null}],"members":[{"type":"individual","id":"df040f15107d8f40","login":"xaris","name":"Xari","avatar_url":"https://avatars-next.observableusercontent.com/6a79baea2b1a1f8cbf7fc9fd58b7a67b61b9ed43b4ecb7aa2cbd3c41df7b533d","tier":null,"role":"editor"}],"comments":[],"custom_thumbnail":false,"trashed":false,"lapsed":null,"subscribed":null,"forks":26,"collection":null,"type":"notebook","body":{"title":"Doodle recognition with TensorFlow.js","cells":[{"id":0,"value":"$34","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","output":"$undefined","database":"$undefined"},{"id":1423,"value":"html` $\"Google's$ `","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","output":"$undefined","database":"$undefined"},{"id":1428,"value":"md`Below is the list of classes from the dataset that we used to train our model. Keep these in mind when you try drawing your own doodles. For example; if you try drawing a frog or a fork, your prediction won't work. But a sheep should work. As will a ship, or any of the other items in the array below.`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","output":"$undefined","database":"$undefined"},{"id":857,"value":"labels = [\n \"bird\",\n \"book\",\n \"car\",\n \"cat\",\n \"chair\",\n \"flower\",\n \"plane\",\n \"sheep\",\n \"ship\",\n \"strawberry\"\n];","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","output":"$undefined","database":"$undefined"},{"id":1434,"value":"md`Below is the drawable canvas element. Use your mouse to draw your doodle on it. Try drawing a chair, for example. When you're done, click the blue button below to make your prediction.`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","output":"$undefined","database":"$undefined"},{"id":1578,"value":"canvas = drawableCanvas();","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","output":"$undefined","database":"$undefined"},{"id":1519,"value":"{\n const letters = bestGuess\n .toUpperCase()\n .split(\"\")\n .map((letter, i) => {\n const rand = Math.floor(Math.random() * Math.floor(colors.length - 1));\n const fill = colors[rand];\n\n return `${letter}`;\n });\n \n const textNode = svg`${letters}`;\n \n return svg``;\n}","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","output":"$undefined","database":"$undefined"},{"id":1290,"value":"// https://beta.observablehq.com/@mbostock/wait-until-button\nviewof predictButton = {\n const form = html`