31:T626,{ // If this page is outside of Observable, set the default styles to approximate // the appearance of the Observable Look and Feel. if (ui === "custom") { return htl.html`

Note: This is an archived version of an Observable Notebook supplement for the RAMPVIS PhilTransA submission titled: 
"Visualization for Epidemiological Modelling: Challenges, Solutions, Reflections & Recommendations"
For the live version, see here: https://observablehq.com/@jsndyks/rampvis-idiom-design-by-immersion

`; } else { return htl.html`

Note: This is a live version of the Observable Notebook supplement for the RAMPVIS PhilTransA submission titled 
"Visualization for Epidemiological Modelling: Challenges, Solutions, Reflections & Recommendations"

`; } }32:T586,The _data_ upon which this reflection is based is highly qualitative. It consists of a diverse set of notes, prototypes, data sketches, communications and memories of the experiences lived during our engagement in 2020. Links to some of this information are provided below, but this is an incomplete selection of a wider set of interactions involving explanations, suggestions, discussion and design interventions: * [Simple Network Sim - Visualization](https://gicentre.github.io/scrc/docs/simpleNetworkSim-VIS/questions.html) * [Simple-Network-Sim - Flows](https://gicentre.github.io/scrc/) * [SCRC: visualization / Data Visualization Design Discourse](https://zulip.scrc.uk/#narrow/stream/17-visualisation/topic/Data.20Visualization.20Design.20Discourse/near/6453) * [SCRC: simple_network_sim / Visualization](https://zulip.scrc.uk/#narrow/stream/15-simple_network_sim/topic/Visualization/near/12478) Much of the engagement was based around the [Simple Network Simulation](https://github.com/ScottishCovidResponse/simple_network_sim) model and discussions with the team involved. The digital data used in developing and assessing this particular model is listed in notebooks associated with that activity: * [RAMPVIS : Directional flow curves](https://observablehq.com/@jwolondon/rampvis_idiom_directional_flow_curves) * [RAMPVIS : The OD Map](https://observablehq.com/@jwolondon/rampvis_idiom_odmap)33:T71b,However, key literature and concepts used in developing the **Design By Immersion** activities include a series of papers that describe this space: * The **Nested Model** for Visualization Design and Validation - [Munzner (2009)](https://doi.org/10.1109/TVCG.2009.111), describes 4-levels of cascading threats to visualization research validity: _problem characterisation_, _task and data abstraction_, _encoding and interaction design_, and _algorithm design_; * **Design Study Methodology** - [Sedlmair et al. (2012)](https://doi.org/10.1109/TVCG.2012.213) - a process model containing 9 stages to structure engagement and 23 pitfalls to be avoided while doing so. DSM is intended to guide visualization researchers and show the "_iterative dynamics_" of applied visualization design work * **Action Design Research** - [McCurdy et al. (2016)](https://doi.org/10.1145/2993901.2993916) - provides a focus on knowledge construction through the co-design of artefacts. These, and associated knowledge, are developed through Building/Intervention/Evaluation loops in which design is used to disrupt (and improve) process. Key concepts include _Reciprocal Shaping_ -- the development of designs and design ideas from complimentary sources; _Mutually Influential Roles_ -- close collaboration that causes shifts in knowledge, practice and approaches to design and problem solving as perspectives are shared and learning occurs. * **Risk the Drift!** - [Hinrichs et al. (2017)](http://hdl.handle.net/10023/11778) - which explores theses shifting knowledge spaces and research roles involved in design collaborations between humanities researchers and visualization designers. These approaches were used to frame much of the SCRC engagement and have been applied and developed in numerous visualization design studies.34:T7c6,In _Design by Immersion_ terminology the digital workplace and associated protocols supported our efforts to use visualization effectively, so that we could readily: * #### _**D-3**_ _Analyze data collaboratively with domain experts_
all data analysis was digital and cold be screen-shared; * #### _**S-1**_ _Observe domain experts practices unobtrusively in situ_
data, discussions, demos and explanations were digital and shared; * #### _**S-4**_ _Attend meetings and discussions in the domain_ unobtrusively
again, this was entirely digital and attendance was unlimited and entirely unobtrusive; * #### _**C-4**_ _Translate concepts and material for design team members coming from predominantly visualization or target domain backgrounds_
we used the digital workspace to document voraciously, with _GitHub_ and _Zulip_ providing particular focii for resources, discussions and updates; * #### _**L-2**_ _Gain broader exposure to domain concepts beyond domain problem_
the mass of documentation on all SCRC efforts enabled us to browse and connect to achieve this aim; * #### _**L-5**_ _Participate in simulations of domain work_
the modelling was all about simulation, and the digital workspace made participation straightforward; * #### _**P-3**_ _Start ideating early in the design process using pre-existing domain knowledge_
we shared knowledge and perspectives through Zoom calls and live document sharing, commenting, editing ; * #### _**P-4**_ _Iterate rapidly and collaboratively on designs by leveraging informal domain feedback_
online provided huge capacity for this kind of iterative feedback and critique; * #### _**P-5**_ _Self-critique designs from the visualization and domain perspectives_ as above, we requested and received feedback both in real time and asynchronously in ways that were made possible by the digital workspace and the deep commitment and focus that the pandemic generated. 35:T552,Our experience felt like an intense digital immersion that required, adopted and enhanced _Design by Immersion_ concepts.
For example ... * We were certainly able to _enrich domain understanding_, _explore (and explain) new space_ and _build relationships_ using the digital workspace and the _Design by Immersion_ concepts were helpful in ensuring that this happened.
This enabled us to share and address data challenges. * We prioritised effectively, designing informative visualization that contributed to problem solving, and iterated relatively well in the digital workspace * We were able to share images and reactions - acquiring and contributing knowledge about the use of visualization in this domain
* **P-2** - encodings were inspired by existing visualization created by the modellers; * **P-5** - _self-critique_ became constructive _**co**-critique_; * Communication opportunities were wide, continuous and sometimes verging on the overwhelming - having _everything_ on _GitHub_ was a blessing and a challenge:
* **S-1** - _observe domain experts practices unobtrusively in situ_ - became our way of working; * **C-3** - _informal peer-to-peer communication_ was continuous and valuable; * **L-2** - _gain broader exposure to domain concepts beyond domain problem_ - everything was online, across all sub-projects; 36:[{"id":"ae52f98c2a59ee5a555e50505caf22da79c0142d5451bea59a12aac479cdbf0f8a50cb287e27e9d6be49916e59ec6f7e6ce6b9563c5da69c6c939995bc00e794","href":"https://static.observableusercontent.com/files/ae52f98c2a59ee5a555e50505caf22da79c0142d5451bea59a12aac479cdbf0f8a50cb287e27e9d6be49916e59ec6f7e6ce6b9563c5da69c6c939995bc00e794","name":"dbiFig1.png","type":"image/png","lastModified":1644853232532.376,"size":203931},{"id":"5d963d5c32303a191c4ea5092da546db0c3c660c843dda5ba44749b00b44cdb6dc9cbaf44328122827faf5d22883d3e8b3aa3b28f0dc21256a7892a8938f28fc","href":"https://static.observableusercontent.com/files/5d963d5c32303a191c4ea5092da546db0c3c660c843dda5ba44749b00b44cdb6dc9cbaf44328122827faf5d22883d3e8b3aa3b28f0dc21256a7892a8938f28fc","name":"dbiRAMPVIS.png","type":"image/png","lastModified":1644853232998.731,"size":350842},{"id":"5ac0d6c58f19c98af03ddeb3cd3a3735ebf79a5e33139918b62eab409d4a4f2c495cef4836691d4df5a5b1d121ade79477650020b2ff5c84e03b95694a8d73a1","href":"https://static.observableusercontent.com/files/5ac0d6c58f19c98af03ddeb3cd3a3735ebf79a5e33139918b62eab409d4a4f2c495cef4836691d4df5a5b1d121ade79477650020b2ff5c84e03b95694a8d73a1","name":"dbiSCRCzulip2020.png","type":"image/png","lastModified":1644856330050.759,"size":135394}] 2f:{"title":"RAMPVIS : Design by Immersion","cells":[{"id":0,"value":"# RAMPVIS : Design by Immersion","pinned":false,"hidden":false,"mode":"md"},{"id":711,"value":"$31","pinned":false,"hidden":false,"mode":"ojs"},{"id":360,"value":"---\n## 1. TASK & USERS - User Story","pinned":false,"hidden":false,"mode":"md"},{"id":664,"value":"In the role of ...\n * **visualization researcher** \n\nI would like to ...\n * ** engage with epidemiological modellers in ways that are unobtrusive and yet informative **\n\nSo that I can ...\n * **support the pandemic effort by rapidly ...**\n * *understanding their data challenges*\n * *identifying those that may be best addressed through visualization*\n * *designing informative visualization to do so (through an interactive process that involves feedback and iteration)*\n * *acquiring knowledge about the use of visualization in this domain*","pinned":false,"hidden":false,"mode":"md"},{"id":128,"value":"---\n\n## 2. DATA","pinned":false,"hidden":false,"mode":"md"},{"id":668,"value":"$32","pinned":false,"hidden":false,"mode":"md"},{"id":7,"value":"---\n\n## 3. Design by Immersion\n\n### Opportunities for transdisciplinary visualization design and activities to support it ","pinned":false,"hidden":false,"mode":"md"},{"id":677,"value":"**Design by Immersion** describes _activities_ and _approaches_ through which problem driven visualization work can be used to do three interrelated things:\n\n1. **enrich domain understanding** - _learn_ more about the applications domain\n2. **build transdisciplinary relationships** - help researchers from different disciplines come together to _collaborate_\n3. **develop visualization research contributions** - enable us to _learn_ more about visualization and develop new visualization techniques and problems to be solved.\n\nAll of this is achieved through close collaboration through which colleagues establish and explore possibilities for visualization design in applied contexts.","pinned":false,"hidden":false,"mode":"md"},{"id":1100,"value":"**Design by Immersion** activity is characterized as :\n\n* **Communal** - collaborators enter into each others’ domains;\n* **Personal** - they invest in, are affected by and gain capability in other domains;\n* **Active** - they get stuck in and close to the action, the opposite of passive engagement;\n* **Emergent** - it results in solutions and approaches that emerge from interactions between domains; \n","pinned":false,"hidden":false,"mode":"md"},{"id":763,"value":"Twenty-three activities are suggested and variously involve **data**, **study methods**, **prototyping**, **learning** (about the applications domain), and **communication** between transdisciplinary collaborators.","pinned":false,"hidden":false,"mode":"md"},{"id":1107,"value":"Trajectories for engagement, that suggest pathways between these activities to support effective collaboration are presented as examples of \"_How to Immerse Yourself_\".","pinned":false,"hidden":false,"mode":"md"},{"id":1098,"value":"A three stage process for immersion is suggested :\n1. **Stage #1** - Establishing basic domain knowledge\n2. **Stage #2** - Gaining domain research exposure\n3. **Stage #3** - Establishing a broader domain reputation","pinned":false,"hidden":false,"mode":"md"},{"id":1117,"value":"However, the framework is explicitly flexible, suggesting that the activities may be adopted, adapted or used for inspiration.\nThis seems important in the _Rapid Assistance_ / _Emergency Response_ context, which does not feature in the 6 case studies used to develop the various constructs, or explicitly in the paper at all.","pinned":false,"hidden":false,"mode":"md"},{"id":371,"value":"---\n## 4. ORIGIN & CONTEXT","pinned":false,"hidden":false,"mode":"md"},{"id":685,"value":"**Design by Immersion** was introduced by [Hall et al (2019)](https://doi.org/10.1109/TVCG.2019.2934790) as a way of framing applied visualization research efforts and capturing some of the activities that were seen to be fruitful in terms of establishing and developing relationships across and between disciplines.","pinned":false,"hidden":false,"mode":"md"},{"id":771,"value":"The paper draws upon activities described in existing literature and those established through reflection upon the author team's significant experience of working in a whole range of application domains.\nSix case studies, that span research groups, disciplines and an impressive time-frame, are presented by the diverse set of authors in order to develop the concepts presented.","pinned":false,"hidden":false,"mode":"md"},{"id":787,"value":"One of our RAMPVIS colleagues, Jo Wood, is on the authorship team. ","pinned":false,"hidden":false,"mode":"md"},{"id":793,"value":"The paper pulls together many of the concepts that underpin high quality visualization design research (see below) and offers actionable guidance for activities that are likely to lead in successful collaboration and valuable research.\n\nIn doing so it emphasizes the need for close, regular and intensive collaboration in which boundaries are minimized and levels of trust are high.","pinned":false,"hidden":false,"mode":"md"},{"id":13,"value":"___\n\n## 5. EXAMPLES","pinned":false,"hidden":false,"mode":"md"},{"id":804,"value":"**Design By Immersion** was very new at the start of the SCRC collaboration, having been presented at [IEEE VIS in Vancouver in November 2019](http://ieeevis.org/year/2019/info/papers-sessions). The [Presentation given at InfoVis 2019 by Kyle Hall](https://vimeo.com/369711296) is available and introduces the ideas nicely in 12 snappy minutes of audio and slides. \nAs a consequence examples, other than those given in the paper and upon which the constructs are based, are limited.","pinned":false,"hidden":false,"mode":"md"},{"id":777,"value":"$33","pinned":false,"hidden":false,"mode":"md"},{"id":53,"value":"---\n## 6. DESCRIPTION & USE","pinned":false,"hidden":false,"mode":"md"},{"id":735,"value":"The digital workplace of lockdown with regular video calls, seminars and other online knowledge exchange was effective in enabling\n _Design by Immersion_. Indeed we were required to engage immersively as we sat at home, legally obliged to remain indoors, and connected, worked, analysed and designed through our screens. ","pinned":false,"hidden":false,"mode":"md"},{"id":754,"value":"$34","pinned":false,"hidden":false,"mode":"md"},{"id":895,"value":"We engaged in activities of each type : _**D**ata_, _**S**tudy methods_, _**P**rototyping_, _**L**earning about the domain_, and _**C**ommunicating with collaborators_.","pinned":false,"hidden":false,"mode":"md"},{"id":899,"value":"This was achieved through regular _Zoom_ calls, _GitHub_ commits, active discussion documents and asynchronous threaded discussion and email.","pinned":false,"hidden":false,"mode":"md"},{"id":933,"value":"Here we see numbers of _Zulip_ posts made per day across the SCRC consortium. ","pinned":false,"hidden":false,"mode":"md"},{"id":930,"value":"FileAttachment(\"dbiSCRCzulip2020.png\").image({ width: 600 })","pinned":false,"hidden":false,"mode":"ojs"},{"id":955,"value":"Threaded discussion on _Zulip_ was the main means of communication across the project - there were no in person meetings during lockdown.","pinned":false,"hidden":false,"mode":"md"},{"id":950,"value":"Here we have an example of the kind of interactive graphics used in our explanations and experiments with design solutions. This example is from our discussion around [Glasgow / Strathclyde travel-to-work patterns](https://gicentre.github.io/scrc/docs/flow/glasgow.html) and is typical of the kinds of asynchronous design / analysis discussion documents that formed our digital workspace.\n\nThe instructions on the right invite experimentation.\nFeedback on this and other documents was provided through _Zulip_ discussion.","pinned":false,"hidden":false,"mode":"md"},{"id":938,"value":"","pinned":false,"hidden":false,"mode":"html"},{"id":1032,"value":"All of this used _Design by Immersion_ concepts, but these were to an extent mapped _retrospectively_.\nWe had plenty of experience of engaging in these kinds of activities from prior collaborations and from concepts described in the papers and methodologies listed above. \nBut, _Design by Immersion_ provides useful language, activities and check-points for establishing and maintaining effective collaboration and reflecting upon what has been achieved.","pinned":false,"hidden":false,"mode":"md"},{"id":410,"value":"---\n## 7. REFLECTION","pinned":false,"hidden":false,"mode":"md"},{"id":1085,"value":"Our volunteering during the early stages of the COVID-19 pandemic was deeply _Communal_ and _Personal_.\nOur investment of time and effort during an emergency that affected all of our lives and threatened our futures made this a deeply _Active_ experience to which all were committed. It mattered.\nIn a way, it was more _Personal_, intense and visceral than those proposing _Design by Immersion_ paradigm could have imagined or expected. And yet, the concepts worked pretty well in most cases.","pinned":false,"hidden":false,"mode":"md"},{"id":738,"value":"The digitally immersive engagement helped visualization researchers to quickly develop an understanding of a series of models (data) being developed in parallel by modelling teams (users), identify questions (tasks) to which known visualization approaches might be usefully applied. We felt very connected to _data_ and _user_ and this enabled us to elicit, influence and contribute towards _tasks_. ","pinned":false,"hidden":false,"mode":"md"},{"id":446,"value":"### 7.0 Reflective Discussion ","pinned":false,"hidden":false,"mode":"md"},{"id":1060,"value":"Collaborative analysis, discussion, design, and problem solving are key to _Design by Immersion_, which presents \"_drift_\" between domains as a positive outcome of an engagement.\n\nWe achieved this to an impressive degree.\n The epidemiological modellers learned concurrently about visualization possibilities and practice as visualization was applied to their data and tasks. Visualization researchers learned about the models, their characteristics and the phenomena that they represented.\n\nEpidemiological modellers and visualization experts increased their knowledge about the problem and solution spaces to reduce knowledge gaps and develop inter-disciplinary knowledge.","pinned":false,"hidden":false,"mode":"md"},{"id":910,"value":"Below we annotate the general Fig. 1 from the **Design by Immersion** paper to show schematically how this beneficial and effective drift occurred in our immersive engagement.","pinned":false,"hidden":false,"mode":"md"},{"id":826,"value":"viewof figure = Inputs.radio(\n [\"Original (redrawn from Hall et al., 2019)\", \"RAMPVIS interpretation\"],\n {\n label: \"Select Fig 1.\",\n value: \"Original (redrawn from Hall et al., 2019)\"\n }\n)","pinned":false,"hidden":false,"mode":"ojs"},{"id":818,"value":"{\n if (figure === \"Original (redrawn from Hall et al., 2019)\") {\n return FileAttachment(\"dbiFig1.png\").image({ width: 600 });\n } else {\n return FileAttachment(\"dbiRAMPVIS.png\").image({ width: 600 });\n }\n}","pinned":false,"hidden":false,"mode":"ojs"},{"id":915,"value":"The unobtrusive immersion of the digital workspace allowed us to leverage visualization research to develop solutions to meet the identified needs and opportunities by usefully applying what is known about visualization while minimising the risk of disrupting modellers in their work.","pinned":false,"hidden":false,"mode":"md"},{"id":962,"value":"This achieved the kind of constructive and validating\nreciprocal immersion, shaping and influence ([Hall et al., 2019](https://doi.org/10.1109/TVCG.2019.2934790); [McCurdy et al., 2016](https://doi.org/10.1145/2993901.2993916)) between epidemiologists, modellers and visualization experts that is so core to effective visualization support and successful applied visualization research ([Meyer & Dykes, 2019](https://doi.org/10.1109/TVCG.2019.2934539)).","pinned":false,"hidden":false,"mode":"md"},{"id":965,"value":"Assessing these efforts, either through feedback from modellers on designs, their utility and their ongoing needs, or through fellow visualization volunteers undertaking heuristic assessments, made this an iterative process of learning and design that has parallels with _action research_ ([Sedlmair et al., 2012](https://doi.org/10.1109/TVCG.2012.213); [McCurdy et al., 2016](https://doi.org/10.1145/2993901.2993916); [Meyer & Dykes, 2019](https://doi.org/10.1109/TVCG.2019.2934539)).\n","pinned":false,"hidden":false,"mode":"md"},{"id":415,"value":"### 7.1 What Worked","pinned":false,"hidden":false,"mode":"md"},{"id":1017,"value":"$35","pinned":false,"hidden":false,"mode":"md"},{"id":434,"value":"### 7.2 What Didn't Work","pinned":false,"hidden":false,"mode":"md"},{"id":438,"value":"_Design by Immersion_ offers a \"_a high-level road map of how visualization researchers can immerse themselves in target domains_\" through a series of suggested stages in an _immersion trajectory_.\n\nIn the emergency context the relatively structured, gently building immersion just didn't happen. This was a \"_dive straight into rough water_\" immersion, rather a gentle walk into a calm lake! \n\nThis had an effect on our abilities to focus and document.\n\n* Immersion trajectories are likely even more diverse than suggested in the _Design by Immersion_ paper","pinned":false,"hidden":false,"mode":"md"},{"id":1046,"value":"Explicit requests for feedback were successful in many cases despite the chaos, but not all feedback mechanisms were equally effective.\nWe used _Google Forms_ to try to elicit feedback at one stage. This wasn't effective as it involved another site or application and created a barrier to participation. Our _Zulip_ discussion threads were the best place for feedback.\n\n* Feedback needs to happen in the moment and close to the analysis that is being undertaken. It needs to be delivered in ways tha suit those providing it. Be accommodating and flexible.","pinned":false,"hidden":false,"mode":"md"},{"id":1076,"value":"Lots was happening in parallel - models were being developed as VIS capacity was being provided. This was wasteful at times, but is more than acceptable given the context. _Design by Immersion_ does not account for this particularly well. Dealing with the highly dynamic, hot and cold nature of some engagements is a challenge and design processes might address this more explicitly.\n\n * Things will change, but _Design by Immersion_ won't help you deal with a change in direction or emphasis during collaborative work. ","pinned":false,"hidden":false,"mode":"md"},{"id":1092,"value":"Perhaps _Design in Emergency_ requires a few add-ons to _Design by Immersion_.","pinned":false,"hidden":false,"mode":"md"},{"id":461,"value":"### 7.3 Recommendations & Opportunities","pinned":false,"hidden":false,"mode":"md"},{"id":971,"value":"**Design by Immersion** is an interesting framing that really draws upon and emphasizes existing approaches to applied visualization design research. It gives us some guidance and useful activities. Using these in close collaboration with others in a trans-disciplinary project seems a good way to develop knowledge, and achieve effective solutions, particularly in a digital workspace. ","pinned":false,"hidden":false,"mode":"md"},{"id":980,"value":" * _Design by Immersion_ and be creative in adapting technology and pathways to suit your context - even more widely than those suggested by the experiences documented in the Hall et al. (2019) paper;\n * _Notebooks_ work exceedingly well as a means of capturing design, analysis and discourse around the two - document systematically and fully, reflect on the artefacts ;\n * Be systematic in _encouraging_ and _capturing_ discourse, and in explicitly linking _discourse_ to decisions;\n * _Action Design Research_ complements _Design by Immersion_ well - use interventions to evaluate effect and re-shape problems and solutions in intense, immersive, co-design cycles;\n * In an _emergency_ you have to be cooperative, creative and flexible. Use ideas from _Design by Immersion_ to help your decision-making, but don't be constrained. Adapt your approach to the context in which you are immersed as it emerges.","pinned":false,"hidden":false,"mode":"md"},{"id":624,"value":"### 7.4 Who Was Involved?\n","pinned":false,"hidden":false,"mode":"md"},{"id":628,"value":"The views expressed here are those of the notebook author - **Jason Dykes**.\n\nBut they have developed throughout the engagement, and the process of writing the draft paper for PTRSA, which has in itself involved collating and reading these supplementary materials.\n\nSo, all co-authors, all participants in the SCRC RAMP volunteering, and even the paper reviewers deserve some credit for shaping this notebook. ","pinned":false,"hidden":false,"mode":"md"},{"id":16,"value":"---\n\n## 8. REFERENCES","pinned":false,"hidden":false,"mode":"md"},{"id":688,"value":"**Hall, K. W., Bradley, A. J., Hinrichs, U., Huron, S., Wood, J., Collins, C., & Carpendale, S. (2019).**
\n_Design by immersion: A transdisciplinary approach to problem-driven visualizations._
\nIEEE Transactions on Visualization and Computer Graphics, 26(1), 109-118.
\nhttps://doi.org/10.1109/TVCG.2019.2934790","pinned":false,"hidden":false,"mode":"md"},{"id":701,"value":"**Hinrichs, U., El-Assady, M., Bradely, A. J., Forlini, S., & Collins, C. (2017).**
\n_Risk the drift! Stretching disciplinary boundaries through critical collaborations between the humanities and visualization._
\nProceedings of the Workshop on Visualization for the Digital Humanities
\nhttps://research-repository.st-andrews.ac.uk/handle/10023/11778","pinned":false,"hidden":false,"mode":"md"},{"id":1002,"value":"**McCurdy, N., Dykes, J., & Meyer, M. (2016).**
\n_Action design research and visualization design._
\nProceedings of the Sixth Workshop on Beyond Time and Errors on Novel Evaluation Methods for Visualization (pp. 10-18).
\nhttps://doi.org/10.1145/2993901.2993916","pinned":false,"hidden":false,"mode":"md"},{"id":997,"value":"**Meyer, M., & Dykes, J. (2019).**
\n_Criteria for rigor in visualization design study._
\nIEEE Transactions on Visualization and Computer Graphics, 26(1), 87-97.
\nhttps://doi.org/10.1109/TVCG.2019.2934539\n","pinned":false,"hidden":false,"mode":"md"},{"id":989,"value":"**Munzner, T. (2009).**
\n_A nested model for visualization design and validation._
\nIEEE Transactions on Visualization and Computer Graphics, 15(6), 921-928.
\nhttps://doi.org/10.1109/TVCG.2009.111","pinned":false,"hidden":false,"mode":"md"},{"id":1007,"value":"**Sedlmair, M., Meyer, M., & Munzner, T. (2012).**
\n_Design study methodology: Reflections from the trenches and the stacks._
\nIEEE Transactions on Visualization and Computer Graphics, 18(12), 2431-2440.
\nhttps://doi.org/10.1109/TVCG.2012.213","pinned":false,"hidden":false,"mode":"md"},{"id":57,"value":"---\n### Imports","pinned":false,"hidden":false,"mode":"md"},{"id":549,"value":"import { ui } from \"@mootari/environment\"","pinned":false,"hidden":false,"mode":"ojs"}],"files":"$W36","stdlib":"1","titling":"auto"}