2d:null 2e:["$","title",null,{"children":"Chartability Collection: Techniques for Data Visualization Accessibility | Frank Elavsky | Observable"}] 33:T518,md`# Chartability Collection: Techniques for Data Visualization Accessibility Hello and welcome to this page, which is dedicated as a Table of Contents (or central archive of sorts) for every series related to each topic in Chartability. This collection is supported by my Patreon, so if you found anything helpful here [please consider becoming a patron of this work](https://www.patreon.com/frankElavsky). ## What is Chartability? You can find out more at [the main Chartability site](https://chartability.fizz.studio/). But in summary: Chartability is a methodology for ensuring that data visualizations, systems, and interfaces are accessible. Chartability is organized into principles with testable criteria and focused on creating an outcome that is an inclusive data experience for people with disabilities. ## Why Make More Resources? Well, Chartability is structured just to contain tests. It is a series of requirements that must not fail. But it isn't clear what someone should do in order to pass each test, or what kinds of tricky situations someone can run into when representing data that require extra careful consideration. That being said, making all the resources needed for every single test is a significant undertaking (especially since there are more than 50 tests in total).`34:T9a31,

Perceivable

User must be able to easily identify content using their senses: sight, sound, and touch.

Low contrast (critical)

(select to read more)

This heuristic is synthesized from standards.

Description: Geometries and large text must have >3:1 contrast against background, Regular text must have >4.5:1.

Good example: https://observablehq.com/@frankelavsky/high-contrast-for-data-visualization-with-examples

Example tools or testing method: https://webaim.org/resources/contrastchecker/

Cited standard: https://www.w3.org/WAI/WCAG21/Understanding/non-text-contrast.html

Notes (select to expand)

Low contrast is the most common failure (88% of audits we have performed fail this). It also has the potential to be one of the most inclusive design spaces for representing data, perhaps outside of text treatment, content, and narrative design. Myndex Research (APCA/SPCA work) has noted the limitations of the WCAG 2.0/2.1 Model (which is based off of IEC/4WD 61966-2-1). The WCAG 3.0 Standard is likely to be much better, but work is still ongoing and not likely to become standard until at least 2025 or later.

Only visual (critical)

(select to read more)

This heuristic is synthesized from standards.

Description: Information in the chart must be available without visuals (no screen reader/braille support). At a minimum test using JAWS + Chrome, NVDA + Firefox (on Windows), VoiceOver + Safari (on Mac), and VoiceOver + Safari (on iOS). These devices must be able to access all chart information. All annotations, “visually apparent” trends or features, and all major narrative elements must be exposed to screen readers. Videos, presentations, and animations must include synchronized audio descriptions.

Good example: https://youtu.be/w6ntxLG6MLQ

Example tools or testing method: https://support.apple.com/guide/voiceover/welcome/mac, https://www.nvaccess.org/, https://www.freedomscientific.com/products/software/jaws/, https://support.google.com/accessibility/android/answer/6283677?hl=en

Cited standard: https://www.w3.org/WAI/WCAG21/quickref/#text-alternatives

Notes (select to expand)

The heart of this test is about non-visual access via text alternatives and generally, screen readers and braille readers (in the tools section of this test) are "assistive technologies" (AT) that can determine if this has been done accessibly. Broadly the considerations here in this test may need to expand beyond just using these AT devices someday, depending on whatever technologies are used by people.

Small text size (critical)

(select to read more)

This heuristic is synthesized from research.

Description: Text (any) must not be smaller than 9pt/12px in size. Ideally only minor text is rendered at 9pt (Eg. axis labels) while all other text is larger.

Cited research: https://doi.org/10.1167/17.5.8

Notes (select to expand)

Testing for font size is highly complex and difficult if it isn't stored in data/metadata or known by the designer/developer. This is a difficult metric to measure and more tooling is needed to help with this. In addition, WCAG 2.1 has no requirement for text size. Ongoing work for 3.0 (thanks to Myndex) is integrating contrast evaluation with "size" (roughly approximating perceptial angle), since plenty of research has shown that size affects discriminability. But as we mentioned in the contrast limitations, this work is ongoing and non-standard. For more community resources, see: https://accessibility.psu.edu/fontsizehtml/

Visual presents seizure risk (critical)

(select to read more)

This heuristic is synthesized from standards.

Description: Chart must not pose a seizure risk when static or active. Chart must avoid red flashes and should avoid animating with red or have a significant portion of the display area use the color red. Tools like PEAT may be used to assess risk.

Example tools or testing method: https://trace.umd.edu/photosensitive-epilepsy-analysis-tool-peat-user-guide/

Cited standard: https://www.w3.org/TR/UNDERSTANDING-WCAG20/seizure.html

Notes (select to expand)

We also acknowledge the work of South et al in their IEEE VIS poster where they used repeated scrolling techniques on what would otherwise be a static graphic to test for seizure risk with PEAT. We believe that the complex nature of interactive data experiences could merit more methodological attention for evaluating seizure risk.

Color is used alone to communicate meaning

(select to read more)

This heuristic is synthesized from standards.

Description: Color must not be the only channel for conveying meaningful or essential information. For categorical color schemes: Textures, shapes, or size (for filled elements) or dash patterns (for lines and paths) are required.

Good example: https://observablehq.com/@frankelavsky/no-use-of-color-alone-in-data-visualization

Cited standard: https://www.w3.org/WAI/WCAG21/Understanding/use-of-color.html

Notes (select to expand)

While this standard is very difficult for the field of data visualization to wrestle with, there is also little research that explores effective strategies. We need more work in this space, especially for color schemes that scale based on numerical data (sequential, ordinal, etc). See: https://observablehq.com/@frankelavsky/experimental-color-scale-textures

Meaningful elements can be distinguished from each other

(select to read more)

This heuristic is synthesized from standards.

Description: Primary chart elements must not be obscured by other elements (only a failure if discriminability or separability is required to understand the chart). Adjacent elements must have at least 1px white space between them (like stacked bars or pie charts where elements “touch”). Text (any) must not be obscured or overlapped by any other elements.

Good example: https://observablehq.com/@frankelavsky/contrast-and-no-use-of-color-alone-in-scatterplots#getting-a-better-look

Cited standard: https://www.w3.org/WAI/WCAG21/Understanding/distinguishable

Notes (select to expand)

Distinguishability is the higher level principle (above contrast) and helps guide how contrast is calculated. But it also is generally concerned with how we "perceive one thing from another," which is why this is separate from contrast. The gestalt techniques here especially have a very different approach than with contrast.

Not CVD-friendly

(select to read more)

This heuristic is synthesized from research.

Description: Color choice should be “colorblind safe” (distinguishable to people with color vision deficiencies). Use tools like Viz Palette or Chroma to test the chart's color palette. Must not have major warnings on either.

Good example: https://blog.datawrapper.de/colorblindness-part1/

Example tools or testing method: https://projects.susielu.com/viz-palette, https://vis4.net/palettes

Cited research: https://doi.org/10.1007/s10209-021-00816-0

Notes (select to expand)

Obviously we would imagine that standards require color vision deficiency consideration and this is actually where "no use of color alone" comes from. However, while it is assumed that having both high contrast and textures can resolve all CVD issues, it is still important to test color schemes against CVD simulations. So this heuristic is considered based on research, which we use Martínez et al's heuristics research for CVD in charts here.

Spacing is inappropriate

(select to read more)

This heuristic is synthesized from community practices.

Description: Use of white space and other forms of padded, structured spacing should be appropriate. Too much or too little white space on charts with intervals (like a bar chart with thin bars and large gaps or vice a versa) can cause perceivable and understandable issues.

Good example: https://towardsdatascience.com/data-visualisation-principles-part-1-white-space-text-and-colour-13f520f90ce9

Cited community practice: https://www.calliaweb.co.uk/whitespace-not-just-a-waste-of-space

Notes (select to expand)

While Headings and Labels are standards (2.4.6 and 2.4.10) for spacing and hierarchy reasons, "white space" specifically is a lower-level consideration that is massively important in effective, accessible data visualization. There is a research gap in this space. Another community article: https://medium.com/nightingale/how-to-use-whitespace-the-punctuation-between-visual-elements-5ff449709759

Operable

All controls must be error-tolerant, discoverable, and multi-modal (not just mouse operable, but using keyboard, etc).

Interaction output only has one input (critical)

(select to read more)

This heuristic is synthesized from standards.

Description: If chart is interactive with a mouse (or another input device) it must also be made interactive for use with a keyboard. Test navigating to chart with keyboard, using tab and arrow keys. Focusing should mirror hovering, selecting (enter or spacebar) should mirror clicks. The chart must also be tested with a touch device and screen reader, as these devices may have different experiences than a keyboard.

Good example: https://progressiveaccess.com/chemistry/

Cited standard: https://www.w3.org/WAI/WCAG21/Understanding/keyboard-no-exception.html

Notes (select to expand)

The keyboard interface (not literal keyboards but the technology they use to interface with software) is the single, most important thing to build and ensure when creating interactive content. Screen reader operability should always be tested alongside keyboard-only testing. In addition, we also should consider touch interaction. But how do we think about touch interfaces? Touch input often follows what is called the "pointer" interface, coupling mouse and touch interactions together. But touch has a much larger hit area, causing significant accessibility issues on mobile devices. This is largely an unsolved problem.

No interaction cues or instructions (critical)

(select to read more)

This heuristic is synthesized from standards.

Description: If chart has any interactive capabilities at all, it must be explained somewhere for users to understand. All keyboard controls must also be explained as well.

Good example: https://sf.gov/resource/2021/covid-19-data-and-reports

Cited standard: https://www.w3.org/WAI/WCAG21/Understanding/labels-or-instructions.html

Notes (select to expand)

We have had long battles (in professional experience) with designers on this point. "Why do I need to provide instructions? If it is a good design, no instructions are needed!" And that simply is an ableist assumption. Instructions must be provided for any and all interactivity, including instructions for different input devices: hovering with a mouse or navigating with a keyboard.

Controls override AT controls (critical)

(select to read more)

This heuristic is synthesized from standards.

Description: Custom keyboard and touch controls must not override screen reader settings. Any custom key controls must only apply when the chart or elements have focus (no page or app overrides).

Good example: https://sf.gov/resource/2021/covid-19-data-and-reports

Cited standard: https://www.w3.org/TR/WCAG21/#character-key-shortcuts

Notes (select to expand)

Not only are "keyboard traps" one of the worst experiences for keyboard and screen reader users, but key control overrides (such as overriding the native functionality of the tab key) can cause users significant issues.

Low contrast on interactive elements

(select to read more)

This heuristic is synthesized from standards.

Description: When interactive elements use color to communicate a change of state (like changing opacity, saturation, or hue on hover, focus, or selection), not only must additional indications be provided alongside the color (such as stroke thickness or dash pattern), but the new state should have at least 3:1 contrast against its previous state. Use WebAIM Contrast Tool or dropper tool.

Good example: https://github.com/visa/visa-chart-components/tree/main/packages/utils#interactivity

Cited standard: https://www.w3.org/WAI/WCAG21/Understanding/non-text-contrast.html

Notes (select to expand)

State change for interactivity is important to communicte clearly, arguably imperative for something to be operable. This is a good example of a strong intersection between Perceivable and Operable principles. We put this heuristic into Operability primarily because while it is related to perceivability, it determines operability.

Keyboard focus indicator missing, obscured, or low contrast

(select to read more)

This heuristic is synthesized from standards.

Description: Visual keyboard focus indication must be present and easy to see. Focus indicator must have 4.5:1 contrast against background, must not be fully obscured, and must have at least a 2px border. Use WebAIM Contrast Tool or dropper tool.

Good example: https://github.com/visa/visa-chart-components/tree/main/packages/utils#interactivity

Cited standard: https://www.w3.org/WAI/WCAG22/Understanding/focus-appearance-minimum.html

Notes (select to expand)

Focus indication is one of the most important and also least-designed parts of accessible visualizations. In all of our review, we only found custom, author-provided focus indication in Visa Chart Components and with some Apple charts, when leveraging their accessibility tree. All other keyboard-navigable charts appear to use default styles and assumptions (about enclosure, size, color, etc).

Inappropriate tab stops

(select to read more)

This heuristic is synthesized from standards.

Description: Interactive elements (that represent buttons, links, or selectable features) must have a tab stop, while non-interactive elements must not have a tab stop. Every interactive chart element must NOT have its own tab stop unless the chart is small or the tabs are programmatically revealed (such as having a single tab stop at the root of a chart and then a way to enter further layers or sections of the chart using keyboard controls). At least one tab stop should be provided if a data table succeeds the chart and is interactive, otherwise a table should not have a tab stop.

Good example: https://observablehq.com/@frankelavsky/chart-component-boilerplate

Cited standard: https://www.w3.org/WAI/WCAG21/Understanding/focus-order.html

Notes (select to expand)

This failure is very common for chart design on the web. Often, tabindex will be given to every single element in a chart, even if those elements aren't interactive. This is bad! I believe this practice stems from difficulty making SVG-driven charts accessible to screen readers and keyboard users alike. Note that progressively disclosing layers of tabindexed elements is a good strategy, care should still be taken to avoid placing too much tedium on the user in cases where the chart's childmost layer is dense (see "Navigation is tedious" in Assistive.

Complex actions have no alternatives

(select to read more)

This heuristic is synthesized from standards.

Description: Special actions (brushing/zooming/filtering/gesturing) that use custom or complex chart controls must have a standard UI alternative available. These controls must be clear and easy to use with a keyboard, screen reader, and touch device.

Cited standard: https://www.w3.org/WAI/WCAG21/Understanding/multiple-ways.html

Notes (select to expand)

Both standards for 2.4.5 "Multiple Ways," 2.5.4 "Motion Actuation," and 2.5.1 "Pointer Gestures" all engage this issue. All special actions must have alternatives. Good design even considers alternatives that are not 1 to 1 translations. A 1 to 1 translation might be making a chart keyboard navigable and interactive to match a mouse hover/click. Alternative design for "multiple ways" might be also to provide a search function across the data or chart space in order to directly select elements.

Target pointer interaction size is too small

(select to read more)

This heuristic is synthesized from standards.

Description: Interactive elements that can be targeted by a mouse or touch pointer interaction should have a minimum size of at least 44px x 44px. If elements are scaled according to data values (such as a scatterplot or otherwise), then alternative means must be provided to select, activate, or otherwise interact with the information or task that the element represents. Some examples of this

Good example: https://projects.fivethirtyeight.com/435-representatives/

Cited standard: https://www.w3.org/WAI/WCAG21/Understanding/target-size.html

Notes (select to expand)

This is quite a hard requirement for accessibility in visualization because the spatial dimensions of visual marks are often mapped to variables. We argue that alternatives should be provided such as text labels that satisfy minimum size, accompanying data tables or search functions, alternative navigation and input (such as with a keyboard or non-precise touch input), or features like zooming or filtering. While we applaud efforts such as the use of voronoi diagrams on top of visualizations, we believe that these still pose significant operability barriers for people with motor impairments.

Understandable

Any information or data are presented without ambiguity, with clarity, and in a way that minimizes cognitive load.

No explanation for purpose or for how to read (critical)

(select to read more)

This heuristic is synthesized from research.

Description: Chart should explain its purpose and how to read, use, and interpret it.

Cited research: https://doi.org/10.1109/TVCG.2019.2917689

Notes (select to expand)

The criteria for 1.3.6 "Identify Purpose," 3.3.2 "Labels or Instructions," and 3.3.5 "Help" all fail to necessitate explaining how to read a complex data visualization. Even simple data visualizations can give people trouble interpreting or understanding.

No title, summary, or caption (critical)

(select to read more)

This heuristic is synthesized from research.

Description: A title, summary, context, or caption must be provided.

Cited research: https://doi.org/10.1109/TVCG.2015.2467732

Notes (select to expand)

We use Borkin et al here. The criterion 2.4.6 "Headings and Labels" is interesting in that it doesn't require headings and labels to be present, but only requires them to be sufficiently descriptive IF present. This is a serious flaw in the current standards, which is why we look to research in this space. https://www.w3.org/WAI/WCAG21/Understanding/headings-and-labels.html

Reading level inappropriate (critical)

(select to read more)

This heuristic is synthesized from standards.

Description: All text (and alternative text) provided must target a reading grade level of 9 or lower. Tools may be used to automate reading level estimation.

Example tools or testing method: https://hemingwayapp.com/

Cited standard: https://www.w3.org/TR/UNDERSTANDING-WCAG20/meaning-supplements.html

Notes (select to expand)

Special circumstances may require complex terminology, but these should be explained using a reading grade level of 9 or lower.

Interactive context is not clear

(select to read more)

This heuristic is synthesized from standards.

Description: If chart can affect the logic or layout of the page or if receives data or parameters from other UI controls or logic, this must be clearly communicated in text. Alerts or notifications must be provided than can be monitored programmatically without requiring navigation (to notify screen reader users, for example).

Cited standard: https://www.w3.org/WAI/WCAG21/Understanding/status-messages.html

Notes (select to expand)

Interactive charts often affect different areas of a page or view and different areas of a page or view can often affect charts. This relationship should always be clear to the user, as well as changes to state caused by the chart or its context. This uses criteria 4.1.3, 3.3.5, and 3.3.2.

Information complexity is inappropriate

(select to read more)

This heuristic is synthesized from research.

Description: Information complexity must be appropriate to the task or goal of the visual. Often, this is an issue when charts have too many different kinds of information encoded (note that this isn't the same as density). Chart must not have more than one Y or X axis without first presenting two chart separately. Chart must not encode along a third spatial dimension (z axis) unless the data itself is 3D (spatial, modeling, etc). Chart should not contain more than 5 data categories.

Cited research: https://nces.ed.gov/FCSM/pdf/2003FCSM_BlessingBradsher.pdf

Notes (select to expand)

Dual axis graphs in particular have been a contentious topic in visualization. We have encountered arguments in favor of using them when your audience are "trained experts." However, we are not sure how someone can evaluate their own audience's level of skill in a way that also ensures accessibility. We are also unsure of the benefits afforded this small group. But in any case, the point here is to exercise significant caution and to know that using dual axis graphs is inaccessible to a broad audience (and likely even expert audiences) as it is primarily an attentive, not pre-attentive, chart design.

Changes are not easy to follow

(select to read more)

This heuristic is synthesized from research.

Description: Chart changes must be easy to follow. If a chart’s data change is meaningful, it must employ animations for object constancy (no faster than 200ms or longer than 2s). Changes to state must be announced to screen reader users.

Cited research: https://doi.org/10.1007/978-1-4842-1928-7_2

Notes (select to expand)

Object constancy, as Bostock refers to it, is likely understudied in visualization research and certainly hasn't been interrogated from an accessibility perspective. Much more work needs to be done here.

Metrics and variables are undefined

(select to read more)

This heuristic is synthesized from research.

Description: Metrics or variables must not be misleading or undefined. Chart must not lie and data (and source) must be defined. Metadata, metrics, calculations, and variables must be defined.

Good example: https://www.wgbh.org/foundation/ncam/guidelines/effective-practices-for-description-of-science-content-within-digital-talking-books

Cited research: [NCAM, Diagram Center](NCAM, Diagram Center)

Notes (select to expand)

This seems straightforward enough on the surface: define the variables you are using. Often larger articles will explain variables or metrics in the body text of nearby paragraphs, but it is important to bring this information as close to a chart or data interface as possible so that someone can have the information ready and convenient.

Statistical uncertainty isn't clearly communicated

(select to read more)

This heuristic is synthesized from research.

Description: Statistical confidence/uncertainty must be clearly and unambiguously communicated. If any statistical confidence interval exists, it must use clear conventions and provide textual explanation.

Good example: https://doi.org/10.1145/3173574.3173718

Cited research: https://doi.org/10.1145/3173574.3173718

Notes (select to expand)

Hullman and Padilla are arguably both the giants of research in this space. Both of them have many papers in this space worth exploring for techniques and findings. The biggest limiation worth noting is that due to the complexity of this space, there may be contexts where it isn't entirely clear how to best communicate uncertainty (both from a cognitive accessibility standpoint and ethically).

Axis labels are unclear or missing

(select to read more)

This heuristic is synthesized from community practices.

Description: Axis labels should be present and clear. Axis must not be truncated without a clear label. In rare cases axes may be removed (if adequate text explanation or annotation is provided). Otherwise, axis should be present and clearly labeled. Axis labels may be abbreviated but with a clear and consistent convention.

Cited community practice: https://www.yellowfinbi.com/best-practice-guide/charts-visualizations/chart-axis-best-practices

Notes (select to expand)

We really could use some robust research into axis labelling and design. Not only are there plenty of annoying engineering concerns in this space, but the low-level nature of effective axis design makes it a somewhat tricky problem. The high-level concerns for axis design (not being misleading, when truncation is appropriate, etc) are also relatively understudied from a research perspective. I think that this particular test could easily become a set of standards in our field.

Controls are inappropriate

(select to read more)

This heuristic is synthesized from community practices.

Description: All controls provided must not be irrelevant to the message, question, or task of the chart. Chart's interactive scope and functionality must not be too broad. The chart should if it can have irrelevant functionality removed.

Cited community practice: https://inclusivedesignprinciples.org/#add-value

Notes (select to expand)

This one is actually quite hard to find good example articles for because it seems so obvious. Clearly, one might think, we should not have controls and functionality that are effectively useless or excessively taxing to use. Every component, module, widget, and control we provide should add value. Despite this seeminly apparent requirement, in the our past auditing and industry work we have found that many cognitive barriers exist when interactive data visualization tools and applications have more controls than are necessary for the task. This seems like an easy paper or blog waiting to be written! (See: any dashboard in Tableau. They are all able to drag-select, click, and hover even when those interactive features provide virtually no value to the user. Tableau, especially has a problematic interaction-by-default approach.)

Robust

The design is compliant with existing standards and works with the user’s compliant, assistive technologies of choice.

Does not conform to standards

(select to read more)

This heuristic is synthesized from standards.

Description: The chart must conform to appropriate compliance standards. The chart must pass all relevant WCAG 2.1, Section 508, or equivalent requirements where applicable. (This is intended as an automatic failure until the chart can be fully evaluated.)

Cited standard: https://www.w3.org/TR/UNDERSTANDING-WCAG20/ensure-compat-parses.html

Notes (select to expand)

Chartability is not intended to compete against or completely replace any existing standards and guidelines but work alongside them.

Semantically invalid

(select to read more)

This heuristic is synthesized from standards.

Description: Semantically invalid use of document elements (if it functions like a button, but it is semantically other than a button, etc). Chart must be semantically valid according to modern standards. Initial testing (on the web) may be automated using any combination of: Axe-core, Wave, HTML Codesniffer, Accessibility Insights, or W3C Markup Validation but may only pass once a screen reader test has also verified the experience (see: Perceivable Failures for screen reader info).

Example tools or testing method: https://www.deque.com/axe/devtools/

Cited standard: https://www.w3.org/WAI/WCAG21/Understanding/name-role-value.html

Fragile technology support

(select to read more)

This heuristic is synthesized from standards.

Description: Chart access must not be isolated to one browser, device, software, or operating system. There must be a diversity of technological means to access the chart and its information and functionality.

Cited standard: https://www.w3.org/WAI/WCAG21/Understanding/concurrent-input-mechanisms.html

35:T6d39,

Compromising

(Understandable, yet Robust): Information flows must provide transparency, tolerance, and consideration for different ways that users with assistive technologies and disabilities will prefer to consume different information.

No table (critical)

(select to read more)

This heuristic is synthesized from research.

Description: A table must be provided that contains a human-readable version of the data the chart is based on. This may be excluded if the chart title, summary, context, or annotations are sufficient at conveying all relevant information contained in the chart.

Good example: https://www.wgbh.org/foundation/ncam/guidelines/effective-practices-for-description-of-science-content-within-digital-talking-books

Cited research: https://www.wgbh.org/foundation/ncam/guidelines/effective-practices-for-description-of-science-content-within-digital-talking-books

Notes (select to expand)

Supplying a table is suuported by empirical research via the Diagram Center/NCAM.

Information can only be reached through single process

(select to read more)

This heuristic is synthesized from standards.

Description: There must be more than one process available to reach the same information. If chart is contained within or participates in complex user interface flows, such as transitions between views or states, interacting with filters, or moving between pages, there must be alternative paths to reach that same state (such as with search features, parallel UI controls, etc).

Cited standard: https://www.w3.org/WAI/WCAG21/Understanding/multiple-ways.html

Notes (select to expand)

We have found that many analytical dashboards and applications suffer from their greatest strength, which is the ability to perform deep and complex analysis. These deeply exploratory experiences must have multiple ways to produce the same information. Ultimately, this is an information architecture problem. We recommend reading "Your Information Architecture is an Accessibility Problem" by Sarah Barrett: https://medium.com/known-item/your-information-architecture-is-an-accessibility-problem-cd54ae917f8e

Location and history is clear

(select to read more)

This heuristic is synthesized from standards.

Description: Current location in a system is not easy to understand. Similar to “more than one process” and “easy to share and reproduce,” current view and state of visualization (in a complex environment like a dashboard or app) must provide the user with breadcrumbs to guide their path as well as the ability to save, reload, and navigate history.

Cited standard: https://www.w3.org/WAI/WCAG21/Understanding/location.html

Notes (select to expand)

Breadcrumbs, history, and the ability to save and load all participate in systems that are robust, forgiveable, error-tolerant, and kind to the user. Coincidentally, they are also all more accessible for cognitive reasons, especially when these features are communicated.

Interactions are not forgiveable

(select to read more)

This heuristic is synthesized from research.

Description: Interactions and operations must be forgivable. When the visualization is interactive or has the ability to perform a task, the user must be able to both undo or redo their actions.

Cited research: https://doi.org/10.1080/00140139408964958

Notes (select to expand)

Error tolerance, error-tolerant design, and ideas like Norman's "To Err is Human" are relatively old and well studied. This finds its way into standards, but is unfortunately limited in scope. Interaction errors in data experiences can be quite complex. The criteria for 3.3.6 "Error Prevention (All)" technically only applies to data entry and text fields.

Information cannot be navigated according to narrative or structure

(select to read more)

This heuristic is synthesized from research.

Description: Chart must provide a way to be navigated according to its data or narrative structure. The title, description, annotations, and then lower level data structures should be navigable and in that order. Chart data that contains sub-grouping (like a stacked bar chart) or nesting (like a treemap or hierarchy) must provide keyboard navigation that can navigate between levels and/or laterally across levels (in a non-linear fashion). Keyboard navigation must be comparable to the data structure (including cases where the data structure is novel) as well as provide linear or tabular navigation (like in a table or list).

Good example: https://progressiveaccess.com/chemistry/

Cited research: https://dl.acm.org/doi/abs/10.1145/2745555.2746667

Notes (select to expand)

We use Sorge et al as well as his later work with Godfrey here: https://link.springer.com/chapter/10.1007/978-3-319-94277-3_92. The criteria for 2.4.3 "Focus Order," 2.4.5 "Multiple ways," and 1.3.1 "Info and Relationship" get very close, but don't quite satisfy this. Early community attempts to engage this problem are Leonie Watson's "Accessible SVG Line Graphs" and Doug Schepers' work.

Table/data is static

(select to read more)

This heuristic is synthesized from community practices.

Description: Provided table must at least be downloadable, filterable, or sortable.

Cited community practice: https://inclusive-components.design/data-tables/

Notes (select to expand)

This particular community recommendation actually comes from the our experience working with people with disabilities who are also data experts. In many cases, having a table that is downloadable as a CSV satisfies many concerns since programs like Excel actually handle a lot of needs. A CSV is a low-level, flexible material compared to a chart, meaning that it has more potential to be molded by the user into the experience that suits their needs. Despite this, it is preferable to make tables that are rendered filterable (ideally with a search feature) and sortable.

State is not easy to share and reproduce

(select to read more)

This heuristic is synthesized from community practices.

Description: Chart state must be easy to share and reproduce. If an analysis or complex interaction can produce a customized view, this view must be easy to share (such as with a single link, file, or saved state).

Good example: https://moz.com/blog/everything-you-never-wanted-to-know-about-google-maps-parameters

Cited community practice: https://key2consulting.com/share-power-bi-reports/

Notes (select to expand)

Believe it or not, many complex dashboards and applications with a branching narrative or exploratory style of data interaction have no easy way to share their current state. In professional work in the past, we have found that this is a significant access barrier when an analyst digs deep into their analysis, discovers something worth sharing, and then has no easy way of sharing it. The resulting access barrier is often placed on others. It is both significant cognitive effort as well as a usability problem. Often, an analyst has to result to using a screenshot, but then the labor and "proof in the system" of the analysis is lost! In addition, screenshots are their own accessibility risk (as they must now be made accessible). We challenge engineers to consider how incredible google maps is at maintaining a user's exact parameters in a url so that if they share a link, whoever views it sees the same thing they do. The same cognitive-labor accessibility applies to other complex data interaction spaces.

Assistive

(Understandable and Perceivable but labor-reducing): Interface must be intelligent and multi-sensory in a way that reduces the cognitive and functional labor required for use.

Data density is inappropriate (critical)

(select to read more)

This heuristic is synthesized from research.

Description: Data must be presented at an appropriate density. If more too many elements are competing for the same space (approximate limit is based on cognitive load): clustering or patterns (or lack of) must be explained, chart must be aggregated to a higher level with less elements, or chart must be divided into smaller charts with less data. Visual density should serve a purpose, such as retaining the data's signal (when appropriate).

Good example: https://stackoverflow.blog/2022/03/03/stop-aggregating-away-the-signal-in-your-data/

Cited research: https://vita.had.co.nz/papers/bigvis.pdf

Notes (select to expand)

Data density and comprehension might have studies? However, we couldn't find any research on this from a cognitive or perceptual perspective. Is that because this is such an "obvious" thing that nobody feels the need to question it? It is possible our lit review missed where these papers live.

Navigation and interaction is tedious (critical)

(select to read more)

This heuristic is synthesized from standards.

Description: Large blocks of repeated content must be skippable and interactions where the user is required to perform significant labor must not be considered essential (in content or function). The number of interactions or time required to perform a single task should be measured and compared across modalities (mouse pointer versus sequential keyboard versus search versus voice, etc).

Cited standard: https://www.w3.org/WAI/WCAG21/Understanding/bypass-blocks

Notes (select to expand)

Generally, the number of interactions or time required to complete a task is a usability measurement. But when different assistive technologies and inclusive design patterns are considered, this becomes an accessibility measurement as well. There should not be an access gap for someone's time investment in a data experience solely based on interaction and navigation means. There are significant cognitive accessibility overlaps as working memory and cognitive load increases throughout long and tedious interaction patterns.

Visually apparent features and relationships are not described

(select to read more)

This heuristic is synthesized from standards.

Description: Trends, clusters, patterns, outliers, or significant statistical semantics and findings that are considered “visually apparent” must be described through text at a minimum. Optionally, these features may also be exposed using sonification or tactile means or through other multi-sensory approaches.

Good example: https://www.highcharts.com/docs/accessibility/sonification

Cited standard: https://www.w3.org/WAI/WCAG21/Understanding/info-and-relationships

Notes (select to expand)

This heuristic is actually a significantly unsolved problem when it comes to the building materials we have available to us. Not only are sonifications or tactile experiences often authored in parallel (but separate) from visualizations (and tend to be a 1 to 1 representation), but we lack the semantic tools to describe relationships between parts (such as outliers, comparisons, trends, etc). Many efforts have attempted to automate textual descriptions, but as Lundgard et al point out, this may not be possible at a meaningful level we require in order to understand higher levels of information (see: "Accessible Visualization via Natural Language Descriptions"). This issue is related to 1.3.3 "Sensory Characteristics," but also 1.3.1 "Info and Relationships," which Brennan Young engages in a conversation on ARIA's github: https://github.com/w3c/aria/issues/991#issuecomment-668493619

Data in text is not human-readable

(select to read more)

This heuristic is synthesized from standards.

Description: Data must be formatted to be human-readable. All textual information displayed (in data labels, annotations, axes, tables, legends, etc) must be formatted to an understandable level of content (ie “human readable”). These formats must also be made into versions that can be read and parsed comfortably by screen readers. (For example: 6500000000 should be formatted to 6.5b visually and to “six point five billion” when used in screen reader labels and alt text.)

Cited standard: https://www.w3.org/WAI/WCAG21/Understanding/unusual-words.html

Notes (select to expand)

It is strange that axis labels (especially) have not had an intelligent solution built yet that can parse all the possible states of axis-related data and turn them into something usable and well-formatted for human reading. This could even have implications for well-written alt-text. We believe that this could be a low-hanging fruit for researchers or builders to explore who are looking to make a tool or library that is helpful for many others.

Space does not handle extremes

(select to read more)

This heuristic is synthesized from community practices.

Description: Use of space should appropriately handle extreme difference or similarity in the data. Both extreme quantitative differences and similarities can produce unreadable charts. If chart elements are squished into margins due to outliers or together by too much similarity, this fails. Chart must automatically handle these issues or else it must be made clear to the user through annotations what is happening. If data is dynamic or producing automatic annotations is not possible, then chart must provide a way for the user to sort, divide, or filter the chart space on their own.

Good example: https://towardsdatascience.com/data-visualisation-principles-part-1-white-space-text-and-colour-13f520f90ce9

Notes (select to expand)

Real data is often horrible. In analytical environments, especially those where a chart format is chosen and expected to display data that is the result of a user's interaction with parameters and filters, this problem becomes common. Charts must be adaptive and flexible to the extrema in the data (grow or change to fit new parameters) but also should recognize when parameters result in data that completes for the same space (mentioned in another heuristic). If two lines are so close together that it is almost impossible to see the difference between them, a new chart type might need to be chosen or some filtering should take place instead.

No default "build-your-own" provided

(select to read more)

This heuristic is synthesized from community practices.

Description: If the user is required to craft their own chart (say by combining variables in an analytic environment), a default, opinionated view of the data should be provided as a starting point.

Notes (select to expand)

This particular example comes from our experience working with people with disabilities in product and application testing contexts. "Build your own" analytical experiences are really difficult from a cognitive perspective, especially if this intersects with other access needs.

Flexible

(Perceivable and Operable, yet Robust): Design must respect user settings from user agents (browsers, operating systems, applications) and provide presentation and operation control.

User style change not respected (critical)

(select to read more)

This heuristic is synthesized from standards.

Description: Styling changed by the user must be respected. Chart must not interfere with or override styling changes made by the user (such as importing a custom style sheet for use in an HTML application or web site).

Notes (select to expand)

See: 1.4.4, 1.4.8, 1.4.10, 1.4.12, 2.2.1, 2.2.2, 2.2.4, 2.3.3

Long animations cannot be controlled

(select to read more)

This heuristic is synthesized from standards.

Description: Longer, video-style or explanatory animations must have pause, stop, and start controls. Specifically, animations lasting more than 2 seconds or any looping animations must be able to be paused or stopped. Animations used to communicate transitions in the state of the data that last more than 2 seconds must provide a way for the user to start over.

Cited standard: https://inclusivedesignprinciples.org/#give-control

Notes (select to expand)

See: 2.2.1, 2.2.2, 2.2.4, 2.3.3

Scrolling experiences cannot be altered

(select to read more)

This heuristic is synthesized from standards.

Description: Scrolling experiences must provide a way to be adjusted or opted out of. Infinite scrolling, parallax scrolling, and “scrollytelling” experiences must come with the ability to be turned off or used optionally, with an option like “load more” or “next” in its place for keyboard only users.

Cited standard: https://inclusivedesignprinciples.org/#give-control

Notes (select to expand)

See: 2.2.1, 2.2.2, 2.2.4, 2.3.3

Zoom and reflow are not supported

(select to read more)

This heuristic is synthesized from standards.

Description: Chart space must be able to be zoomed using assistive technology or equivalent. Text, geometries, and all elements must change size appropriate to the type of zoom used. When zooming, content should reflow and not be cut off from view in two directions. Responsive design may need to consider re-arranging the display to ensure that no meaningful information or functionality is lost during reflow.

Cited standard: https://www.w3.org/WAI/WCAG21/Understanding/reflow.html

Notes (select to expand)

See: 1.4.4, 1.4.10, 1.4.12

User's text adjustments are not respected

(select to read more)

This heuristic is synthesized from standards.

Description: Text spacing and font-size changed by the user must be respected. Chart must not interfere with programmatic changes to font sizes or text spacing, such as importing a custom style sheet or using a browser’s build in zoom function. Font size and spacing must adjust accordingly.

Cited standard: https://www.w3.org/WAI/WCAG21/Understanding/resize-text.html

Notes (select to expand)

See: 1.4.4, 1.4.12

Design is not consistent and familiar

(select to read more)

This heuristic is synthesized from standards.

Description: Design must be consistent and familiar by default. Charts must be made consistent with one another across an application or environment, including sharing default styling and settings as well as those set by the user. Interaction defaults (such as keybindings or interaction patterns) should carry over between charts that perform the same task or funciton.

Cited standard: https://www.w3.org/WAI/WCAG21/Understanding/consistent-identification.html

Contrast and textures cannot be adjusted

(select to read more)

This heuristic is synthesized from community practices.

Description: Contrast or textures must provide a way to be adjusted as-needed. Chart must not interfere with or override user’s independent contrast adjustments and chart must adjust accordingly to new settings. Chart textures (such as those used on fills) must be able to be turned on or off according to user preference.

Cited community practice: https://observablehq.com/@frankelavsky/experimental-color-scale-textures

Notes (select to expand)

In experiences with audiences in the past, we have found that if some chart textures are on by default, we are creating accessibility barriers due to their visual complexity (we lose or complicate pre-attentive features as well). So we argue that textures (whether on by default or not) must be able to be toggled according to user preference. Much more work and research needs to be done in this space, especially as it challenges the idea that a single design can satisfy everyone's access needs.

Difficult chart type has no alternative

(select to read more)

This heuristic is synthesized from research.

Description: The user should be able to adjust the type or presentation of difficult or complex charts into more accessible alternatives that still accomplish the same analytical task.

Good example: http://cu-visualab.org/IDD/demo/

Cited research: https://dl.acm.org/doi/pdf/10.1145/3411764.3445743

Notes (select to expand)

Pie charts, line charts without discrete marks, and bar charts without countable isotypes all pose cognitive difficultes. Chart types that are high risk for difficulty or misinterpretation should be presented alongside alternative charts or alternative explanations and charts should be available to help the user perform the same tasks. Optionally, users should be provided control over the presentation style of these chart types (eg change pies into treemaps or stacked bars, add discrete marks to line intervals, or add countable isotypes to divide bars).

36:T4df,props = { return { mainTitle: "Our Current Guidance Coverage: 8.7%", subTitle: "This chart represents the number of Chartability Topics that have been covered by a notebook series yet to date, starting in August of 2021. So far we only have 4 topics covered.", data: [ { Category: "Current Status", Group: "Topics Covered", Count: 4 }, { Category: "Current Status", Group: "Topics not yet Covered", Count: 46 } ], height: 100, padding: { top: 20, bottom: 20, right: 20, left: 20 }, colors: ["#555599", "#eeeeee"], ordinalAccessor: "Group", valueAccessor: "Count", groupAccessor: "Category", uniqueID: "observable-bar-chart", layout: "horizontal", yAxis: { visible: false, gridVisible: false }, xAxis: { label: "", visible: true, normalized: true }, showTotalValue: false, accessibility: { longDescription: "This bar tracks the data as each notebook series is added to this collection.", executiveSummary: "Only 1 series has been published so far, out of 45 total.", elementsAreInterface: false, disableValidation: true, hideTextures: false, hideStrokes: false, onChangeFunc: removeGreyTexture } }; }37:[] 31:{"id":"20e82319f1e56208","slug":"chartability","title":"Chartability Collection: Techniques for Data Visualization Accessibility","thumbnail":"9764bf70b1fe096652a162be4b177e09f711e850f36c39d5be48cc79d435df9b","access_level":"public","create_time":"$D2021-08-13T21:59:32.599Z","update_time":"$D2022-04-15T21:52:49.387Z","view_time":null,"first_public_time":"$D2021-08-14T19:57:37.129Z","has_unpublished_edits":null,"fork":false,"stars":29,"starred":false,"owner":{"type":"team","id":"c3bd7bbc9a524700","login":"frankelavsky","name":"Frank Elavsky","avatar_url":"https://avatars-next.observableusercontent.com/3c4e2fa9ff4b9e458bca39646765dab0fba91dfb722060b9599036e4db6195f4","tier":"starter_2024","bio":"Engineer and researcher looking at the intersection of accessibility and complex, data-driven interfaces and systems."},"version":121,"publish_version":null,"role":null,"authored":false,"authors":[{"type":"individual","id":"5e177b2f8569cee2","login":"frankelavsky","name":"Frank Elavsky","avatar_url":"https://avatars-next.observableusercontent.com/ee76bf4ebb5a6577bdcd0286be8a9ebe2e97d00d484159960125255eb03ebfd3","tier":null,"bio":"Engineer and researcher looking at the intersection of accessibility and complex, data-driven interfaces and systems."}],"members":[{"type":"individual","id":"5e177b2f8569cee2","login":"frankelavsky","name":"Frank Elavsky","avatar_url":"https://avatars-next.observableusercontent.com/ee76bf4ebb5a6577bdcd0286be8a9ebe2e97d00d484159960125255eb03ebfd3","tier":null,"role":"editor"}],"comments":[],"custom_thumbnail":false,"trashed":false,"lapsed":null,"subscribed":null,"forks":0,"collection":null,"type":"notebook","body":{"titling":"auto","title":"Chartability Collection: Techniques for Data Visualization Accessibility","cells":[{"id":0,"value":"$33","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":17,"value":"chart = {\n let barChart = document.querySelector(\"stacked-bar-chart\");\n if (!barChart) {\n barChart = document.createElement(\"stacked-bar-chart\");\n }\n Object.keys(props).forEach(prop => {\n barChart[prop] = props[prop];\n });\n return barChart;\n}","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":14,"value":"Want more coverage? [Consider supporting my patreon](https://www.patreon.com/frankElavsky).\n\n## The Shortlist\nFor now since coverage is so scant, these are the links to completed series in this collection:\n1. [Contrast and Color Series notebooks on Observable](https://observablehq.com/@frankelavsky/chartability-contrast-series)\n\n## The Full List\nThe full list of heuristics in Chartability can be found on the [webpage for Chartability's Workbook](https://chartability.github.io/POUR-CAF/), which always reflects the latest version. The information below may sometimes be out of date, so it is just for reference:","pinned":false,"hidden":false,"mode":"md","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"","database":"$undefined"},{"id":109,"value":"$34","pinned":false,"hidden":false,"mode":"html","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"","database":"$undefined"},{"id":113,"value":"$35","pinned":false,"hidden":false,"mode":"html","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"","database":"$undefined"},{"id":67,"value":"md`This notebook uses [Visa Chart Components](https://github.com/visa/visa-chart-components) for its examples.\n\nThis series is supported by [my Patreon page](https://www.patreon.com/frankElavsky).`","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":31,"value":"$36","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":44,"value":"removeGreyTexture = () => {\n window.setTimeout(() => {\n const elements = document.querySelectorAll(`rect`);\n elements.forEach(e => {\n if (e.getAttribute('fill') === 'url(#observable-bar-chart_texture_1)') {\n e.style.fill = '#eeeeee';\n }\n });\n }, 500);\n}","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":18,"value":"{\n const newScript = document.createElement(\"script\");\n newScript.setAttribute(\"data-stencil-namespace\", \"stacked-bar-chart\");\n document.body.appendChild(newScript);\n\n return require(\"@visa/stacked-bar-chart@5.0.1/dist/stacked-bar-chart/stacked-bar-chart.js\");\n}","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":22,"value":"{\n const tableScript = document.createElement(\"script\");\n tableScript.setAttribute(\"data-stencil-namespace\", \"visa-charts-data-table\");\n document.body.appendChild(tableScript);\n\n return require(\"@visa/visa-charts-data-table@2.1.1/dist/visa-charts-data-table/visa-charts-data-table.js\");\n}","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"},{"id":25,"value":"{\n const instructionsScript = document.createElement(\"script\");\n instructionsScript.setAttribute(\n \"data-stencil-namespace\",\n \"keyboard-instructions\"\n );\n document.body.appendChild(instructionsScript);\n\n return require(\"@visa/keyboard-instructions@1.1.3/dist/keyboard-instructions/keyboard-instructions.js\");\n}","pinned":false,"hidden":false,"mode":"ojs","author":"$undefined","summary":"$undefined","tool":"$undefined","providerMetadata":"$undefined","attachments":"$undefined","output":"$undefined","database":"$undefined"}],"files":"$W37","stdlib":"1"}} 32:"$31:body"