I Used Free ChatGPT To Analyze Survey Data. Here's What I Learned.

1. You collect this type of survey data.

Here’s a familiar scenario. You survey your clients, participants, donors, volunteers, etc. and you include some “Other, please specify” options or other “open-ended” questions to better understand respondents’ opinions, experiences, etc.

2. But you don’t know what to do with it.

You collect your survey data but don’t have the time and/or analytical skills to deal with this qualitative data.* Maybe you create one of those horrible word clouds or, even more likely, you just analyze the quantitative data and ignore the qualitative data.

If you had the time and know-how, you might have “coded” the data in order to analyze it. This involves assigning themes to each open-ended survey response in Excel (or the like) or perhaps using one of these free tools.

*Quantitative data is numerical, countable, or measurable. Qualitative data is interpretation-based, descriptive, and relating to language.

3. But what about AI?

You’ve heard that it’s supposed to make tedious, repetitive tasks much easier, and coding survey responses certainly qualifies as both. Could you use the free version of ChatGPT to get this job done? I shared your curiosity and gave it a try. Bottom line: It helped to identify themes to use as codes but it didn’t do all the work for me. For a little longer description of my experience, keep reading.

4. Prepare for AI.

I watched this YouTube Video based on this article to learn how to craft a prompt that would likely get me what I wanted. I also found free survey data on the City of Chicago Data Portal to use for my experiment. The survey asked 43rd Ward residents about “other priorities” for their ward. I thought I could just upload the CSV data file to Chat, but it turns out you need the paid version for that. So I ended up pasting in the survey answers after entering the prompt. Also note that I used publicly available data. You should think twice about entering any type of sensitive data into Chat.

5. Craft the prompt.

Here it is. Yes, it’s long and yes, I say “please,” although I’m not sure if that affected the results!

6. Here’s what happened.

I first tried pasting in the prompt plus the data but that was too long for Chat. So I had to feed the data (all 23 pages) in batches of about 3 pages at a time and despite entreaties to Chat to update the charts based on ALL of the data I shared so far, it only gave me charts for the last batch I had entered, and I had to combine them in Excel. At first I was impressed with the almost instant tables, but I felt my AI assistant wasn’t quite listening to my instructions or just not understanding them. Still, I did develop this list of themes and Chat did code each survey response according to these themes, but I would not feel comfortable relying on these results and would want to possibly combine some of these themes and read through all the responses to see if I agree with the coding.

To see past data tips, including those about other chart types, scroll down or click HERE.

Let’s talk about YOUR data!

Got the feeling that you and your colleagues would use your data more effectively if you could see it better? Data Viz for Nonprofits (DVN) can help you get the ball rolling with an interactive data dashboard and beautiful charts, maps, and graphs for your next presentation, report, proposal, or webpage. Through a short-term consultation, we can help you to clarify the questions you want to answer and goals you want to track. DVN then visualizes your data to address those questions and track those goals.

Data Viz Resources You Should Know: Visual Capitalist

Here’s a new addition to my highly-curated resources list: Visual Capitalist. I occasionally write a 60-second data tip describing a particular resource, including why I think it’s cool. And I link each of these tips to a resources list on my website.

What is it?

Visual Capitalist is an on-line publisher of data visualizations. Their aim is to make the world’s data more discoverable. As the name suggests, the visualizations primarily focus on markets, technology, energy, and the global economy but also on education, healthcare, and the environment using public sources of data including government entities (i.e. U.S. Census data, FRED, etc.), intergovernmental organizations (IMF, World Bank, etc.), or established thought leaders in their respective sectors (think tanks, non-profits, corporations).

Who’s it for?

Anyone who wants to understand or show information on markets, technology. energy, healthcare, education or the global economy. They allow much of their original visual content to be used by others. In many use cases, this can be done for free. (See more info on using their content.)

Who’s behind it?

Visual Capitalist is independently owned, with its founder, Jeff Desjardins, as a majority shareholder.

Why I think it’s cool

Their visualizations can be quite engaging with high production values. You can share them on social media for free. Sign up for a free subscription on any page of their website to get one in your email box each day.

Let’s talk about YOUR data!

Got the feeling that you and your colleagues would use your data more effectively if you could see it better? Data Viz for Nonprofits (DVN) can help you get the ball rolling with an interactive data dashboard and beautiful charts, maps, and graphs for your next presentation, report, proposal, or webpage. Through a short-term consultation, we can help you to clarify the questions you want to answer and goals you want to track. DVN then visualizes your data to address those questions and track those goals.

Data Viz Inspo

Looking for ways to make your data more engaging? Take inspiration from these data tips on steal-worthy visualizations. Click on the images below to see the whole visualization and get suggestions on what to steal from it.

To see past data tips, including those about other chart types, scroll down or click HERE.

Let’s talk about YOUR data!

Got the feeling that you and your colleagues would use your data more effectively if you could see it better? Data Viz for Nonprofits (DVN) can help you get the ball rolling with an interactive data dashboard and beautiful charts, maps, and graphs for your next presentation, report, proposal, or webpage. Through a short-term consultation, we can help you to clarify the questions you want to answer and goals you want to track. DVN then visualizes your data to address those questions and track those goals.

Behold the Heated Bar Chart

I’ve come across this useful chart a number of times and have yet to find a name for it. So I’m giving it one: the heated bar chart. If a bar chart and a heat map had a baby, it might look like this and be even more powerful than its useful parents. This heated bar chart shows months along the horizontal axis and days of the week along the vertical axis. Darker and longer bars on the two bar charts and darker cells on the heat map show when there has been the highest participation in hours. This allows us to examine patterns in participation. We can see, for example, that the relatively high participation in May is being driven by participation on Mondays during that month but that Monday was not a particularly high participation day during other months. We can also see that, overall, participation was lower during the fall months, regardless of day of the week.

This powerful combo chart can be used with many different types of data fields. For example, you might want to create one showing the number of participants from different gender identity and age groups to see if certain gender groups within certain age brackets are not well represented among your participants.

I made this chart with Tableau Public, the free version of Tableau. But this type of chart can be created with any number of applications. For those of you with at least a little Tableau know-how, check out the steps I took in the comic strip below.

Let’s talk about YOUR data!

Got the feeling that you and your colleagues would use your data more effectively if you could see it better? Data Viz for Nonprofits (DVN) can help you get the ball rolling with an interactive data dashboard and beautiful charts, maps, and graphs for your next presentation, report, proposal, or webpage. Through a short-term consultation, we can help you to clarify the questions you want to answer and goals you want to track. DVN then visualizes your data to address those questions and track those goals.

Pop Quiz: Guess What This Chart Shows

Reposted from September 2022

Go ahead and make a guess from the options below. Then scroll down to see how your response compares with others’ and what the answer is!

Keep scrolling!

The answer: The decline in child poverty in the U.S.


As reported in The New York Times, “the sharp retreat of child poverty represents major progress and has drawn surprisingly little notice, even among policy experts.” Read the article (and view the detailed line chart) to learn more about the role of government aid in lifting children and families out of poverty.

I share this chart with you—in this way—for a couple of reasons:

1) It’s an engagement strategy you can use. Rather than present a list of stats to your audience, you can engage them in your data by first quizzing them on an interesting, fun, or counterintuitive finding from your data.

2) Bad new bias. Bad news is more likely to be reported than good news, possibly because bad news sells, according to this article citing various research. Perhaps because of that bias, we may be more likely to assume a chart is telling a negative story. This chart is a reminder of the importance of taking a broader view to gain a more balanced understanding of an issue.

To see past data tips, click HERE.

Let’s talk about YOUR data!

Got the feeling that you and your colleagues would use your data more effectively if you could see it better? Data Viz for Nonprofits (DVN) can help you get the ball rolling with an interactive data dashboard and beautiful charts, maps, and graphs for your next presentation, report, proposal, or webpage. Through a short-term consultation, we can help you to clarify the questions you want to answer and goals you want to track. DVN then visualizes your data to address those questions and track those goals.

Ideas You Should Steal From This Viz (Installment 13)

“All creative work builds on what came before.” —Austin Kleon in Steal Like An Artist.

Today I offer up another steal-worthy interactive viz that I came across in the Tableau Public Gallery. Scroll down to see what you should steal from it.

Source: Nir Smilga on Tableau Public

Here’s what I suggest you steal from this viz:

  • Small Multiples. To highlight each country and to allow for easy comparisons across countries, Smilga created one small chart per country and placed them alongside each other, aka a “small multiples chart.”

  • Gray comparison trends. While Smilga highlights the trend for the featured country in each chart using color, the trends for other countries are also in each chart but in a light gray. This allows us to easily compare the trend for the featured country to that of others in general.

  • Color distinguishes trend types. Recent downward trends are highlighted in red, and recent upward trends are highlighted in blue.

  • Choose your view. Smilga allows the viewer to customize the view by selecting the number of columns, time period, and countries shown.

To see past data tips, click HERE.

Let’s talk about YOUR data!

Got the feeling that you and your colleagues would use your data more effectively if you could see it better? Data Viz for Nonprofits (DVN) can help you get the ball rolling with an interactive data dashboard and beautiful charts, maps, and graphs for your next presentation, report, proposal, or webpage. Through a short-term consultation, we can help you to clarify the questions you want to answer and goals you want to track. DVN then visualizes your data to address those questions and track those goals.

Why You Should Know About Calendar Heat Maps

Want to see patterns in participation, fundraising, volunteering, or social media measures across an entire year? A calendar heat map might do the trick.

This is a new addition to a series of tips on different chart types. In each tip, l give you need-to-know information in a format akin to the “Drug Facts” on the back of medication boxes: active ingredients (what the chart is), uses (when to use it), and warnings (what to look out for when creating the chart). The idea is to fill up your toolbox with a variety of tools for making sense of data. And the calendar heat map is a simple tool you can put to good use!

Active Ingredients (What is a calendar heat map?)

As in the example above, a calendar heat map shows a measure across days on a calendar. The measure might be the number of participants, dollars raised, volunteers recruited, social media engagement, etc.

Uses

Calendar heat maps provide a great way to see patterns in a measure over time, particularly if month and day of the week are important factors. For example, such a chart can help you detect whether participation is lagging on Mondays during summer months. In the example above, you can scroll over dates for more information and use the program filter to see participation for the selected program. Here are instructions for creating an interactive calendar heat map with Tableau and in Excel.

Warnings

Depending on your needs, other charts that show change over time may be more useful to you. For example, if you need to more clearly see the amount of change over time, a line graph might serve you better. For other chart types that show change over time, see below.

Fun Fact

Here’s a fun calendar heat map showing more/less common birth dates.

Source: Amitabh Chandra on Tableau Public

To see past data tips, including those about other chart types, scroll down or click HERE.

Source: Visual Vocabulary by Andy Kriebel on Tableau Public

Let’s talk about YOUR data!

Got the feeling that you and your colleagues would use your data more effectively if you could see it better? Data Viz for Nonprofits (DVN) can help you get the ball rolling with an interactive data dashboard and beautiful charts, maps, and graphs for your next presentation, report, proposal, or webpage. Through a short-term consultation, we can help you to clarify the questions you want to answer and goals you want to track. DVN then visualizes your data to address those questions and track those goals.

A Common Problem with Survey Data - And How to Avoid It

Sampling bias occurs when some members of the group you are trying to understand are less likely to be included in your data than others. Survey data is especially vulnerable to sampling bias. The data you collect is often not representative of the whole group that received the survey but rather the subgroup that was willing to complete the survey — as illlustrated in the “sketchplanation” above. So here are some quick tips to avoid this type of bias in your survey data:

  • Clearly define the group and related subgroups that you want to understand. Consider what might be necessary to collect sufficient data from all of the subgroups.

  • Follow up with those who don’t respond to the survey to understand why they didn’t respond. Did you ask the wrong questions or target the wrong audience? Apply these insights next time you are planning a survey.

  • Make your survey brief and easy to understand.

  • Finally, don’t overinterpret your survey date. Assess which types of respondents were the least likely to respond and interpret accordingly.

For a fuller explanation of types of sampling bias and strategies to avoid it, check out this SurveyMonkey article.

Let’s talk about YOUR data!

Got the feeling that you and your colleagues would use your data more effectively if you could see it better? Data Viz for Nonprofits (DVN) can help you get the ball rolling with an interactive data dashboard and beautiful charts, maps, and graphs for your next presentation, report, proposal, or webpage. Through a short-term consultation, we can help you to clarify the questions you want to answer and goals you want to track. DVN then visualizes your data to address those questions and track those goals.

How To Create Data Stories That Actually Engage People

Here’s a sneak preview of a workshop I’m doing on September 26th. I’m sharing the first few slides below. Click on the right to advance through them.

Presentation Preview by Amelia Kohm

To tell a story in a way that humans can understand and get behind, it helps to understand humans’ powers and challenges when it comes to consuming data. Then we can make better charts, maps, and graphs (aka data visualizations) and present them in a way that humans can absorb.

I hope you can join me on September 26th, 8:00 am - 9:00 am PT | 11:00 am - 12:00 pm ET. Click HERE to register.

Let’s talk about YOUR data!

Got the feeling that you and your colleagues would use your data more effectively if you could see it better? Data Viz for Nonprofits (DVN) can help you get the ball rolling with an interactive data dashboard and beautiful charts, maps, and graphs for your next presentation, report, proposal, or webpage. Through a short-term consultation, we can help you to clarify the questions you want to answer and goals you want to track. DVN then visualizes your data to address those questions and track those goals.

How To Activate Board Member Fundraising With Visuals

Reposted from January 2023

I recently came across this excellent article by The Fundraising Authority. As promised in the title, it provides a “Simple, Step-by-Step Process for Getting Your Board to Refer New Prospects to Your Non-Profit.” In a nutshell, here are the four steps:

  1. Explain how referrals work and assure your board members that no one they refer will be asked for money until they indicate a desire to get involved.

  2. Show board members how many people they actually know through a mind mapping exercise.

  3. Ask board members for referrals usually in person.

  4. Bring referral success stories back to board meetings on a regular basis.

My tip is to enhance steps 2 and 4 with visuals.

Visuals for Step 2: For the mind map, the point is for board members to brainstorm all the people they know by considering people in different categories of their lives. You can use Canva whiteboards (or a similar tool) to create a mind map that the board member (pictured in the middle) can use to add the names of people in each category on virtual post-it notes.

Visuals for Step 4: The article claims that “this is a key step. Nothing will convince your board members to bring you more referrals than hearing from other board members that have done it successfully.” You can visualize the donors whom various board members brought in using tools like Flourish to show their networks, as in this example. Scroll over the circles to interact with it and learn more. Some board members brought in donors who, in turn, brought in other donors. To make something similar, select one of the network graph templates on Flourish and fill in the data needed. (See snapshots of the data I added for the visual below.)

Links data

(used to show who is connected to whom)

Points data

(used to show groups by color, size points according to amount of donations, and add images for board members)

To see past data tips, click HERE.

Let’s talk about YOUR data!

Got the feeling that you and your colleagues would use your data more effectively if you could see it better? Data Viz for Nonprofits (DVN) can help you get the ball rolling with an interactive data dashboard and beautiful charts, maps, and graphs for your next presentation, report, proposal, or webpage. Through a short-term consultation, we can help you to clarify the questions you want to answer and goals you want to track. DVN then visualizes your data to address those questions and track those goals.

Sure Data Confuses You. You Are An Early Human.

Reposted from August 2022

I recently read this article which suggests that, if we avoid a large catastrophe, we may be living at the early beginnings of human history. That is sort of mind-boggling. But even if we are not early humans, we are certainly at the beginning of our journey with data.

We aren’t so good at processing words and numbers and making sense of them. Think about the last time you looked at a spreadsheet and got the gist of it in a few seconds. By contrast, we can get the gist of a photo in less than a few seconds. That’s because our brains have evolved over millions of years to process visual information — color, shape, size, placement — at lightening speed. Indeed, our survival depended on it. Think about detecting predators in the tall grass at a distance.

Processing words and numbers is a quite recent activity for humans, as the timeline below shows. Perhaps, as our brains evolve, we will be able to discern a spreadsheet at a glance. But, until then, we should consider visualizing our data by translating words and numbers into color, shape, size, and placement in the form of charts, maps, and graphs.

To see past data tips, click HERE.

Let’s talk about YOUR data!

Got the feeling that you and your colleagues would use your data more effectively if you could see it better? Data Viz for Nonprofits (DVN) can help you get the ball rolling with an interactive data dashboard and beautiful charts, maps, and graphs for your next presentation, report, proposal, or webpage. Through a short-term consultation, we can help you to clarify the questions you want to answer and goals you want to track. DVN then visualizes your data to address those questions and track those goals.

Another Data Viz Resource You Should Know: USAFacts

Here’s a new addition to my highly-curated resources list: USAFacts. I occasionally write a 60-second data tip describing a particular resource, including why I think it’s cool. And I link each of these tips to a resources list on my website.

What is it?

USAFacts is dedicated to making government data more accessible. The idea is to help people understand where their tax dollars are going and to help those working on issues of concern in the philanthropic, nonprofit, and public sectors to easily access information to inform their decisions.

Who’s it for?

The general public, policymakers, philanthropists, nonprofit managers, and researchers, among others.

Who’s behind it?

After he retired from tech and began to focus on philanthropy, former Microsoft CEO Steve Ballmer wanted to understand what the government spends on programs to help people and the outcomes of those programs. However, unlike businesses, US governments are not mandated to compile reports on their expenditures. He then hired data analysts to compile this data, and this was the origin of USAFacts, a not-for-profit, nonpartisan civic initiative which is solely funded by Ballmer.

Why I think it’s cool

It’s free and the data is shared under a Creative Commons license. They only ask that you credit USAFacts when using their curated material. Most of their data is visualized and all of it is well-documented. Charts can be easily downloaded in an image format or embedded into your website using an embed code like the chart below.

Let’s talk about YOUR data!

Got the feeling that you and your colleagues would use your data more effectively if you could see it better? Data Viz for Nonprofits (DVN) can help you get the ball rolling with an interactive data dashboard and beautiful charts, maps, and graphs for your next presentation, report, proposal, or webpage. Through a short-term consultation, we can help you to clarify the questions you want to answer and goals you want to track. DVN then visualizes your data to address those questions and track those goals.

Data Viz Resources You Should Know: Data.gov

Here’s a new addition to my highly-curated resources list: Data.gov. I occasionally write a 60-second data tip describing a particular resource, including why I think it’s cool. And I link each of these tips to a resources list on my website.

What is it?

Data.gov is the United States government’s open data site. Open data is data that can be freely used, re-used, and redistributed by anyone - subject only, at most, to the requirement to attribute and sharealike. Data.gov is designed to “unleash the power of government open data to inform decisions by the public and policymakers, drive innovation and economic activity, achieve agency missions, and strengthen the foundation of an open and transparent government.”

Who’s it for?

It’s for the general public.

Who’s behind it?

The U.S. government. More specifically, The U.S. General Services Administration, working with the Office of Management and Budget and other agency partners, launched Data.gov in 2009. Government agencies compile metadata such as title, description, keywords, and links for accessing their datasets, and the Data.gov catalog automatically “harvests” that metadata to populate a continually updated catalog.

Why I think it’s cool

Unlike many other open data catalogs, you can find and download data quickly and visualize it. You can begin by searching for keywords in the search box. And there are helpful filters to narrow the results by, for example, topic categories, location, and agency. This is a great place to find data to show the need for your organization’s services and the problems you and your colleagues are working to address.

Let’s talk about YOUR data!

Got the feeling that you and your colleagues would use your data more effectively if you could see it better? Data Viz for Nonprofits (DVN) can help you get the ball rolling with an interactive data dashboard and beautiful charts, maps, and graphs for your next presentation, report, proposal, or webpage. Through a short-term consultation, we can help you to clarify the questions you want to answer and goals you want to track. DVN then visualizes your data to address those questions and track those goals.

Why You Should Know About Cycle Plots

If you are looking to explore patterns in participation or giving, a cycle plot can get you there.

This is a new addition to a series of tips on different chart types. In each tip, l give you need-to-know information in a format akin to the “Drug Facts” on the back of medication boxes: active ingredients (what the chart is), uses (when to use it), and warnings (what to look out for when creating the chart). The idea is to fill up your toolbox with a variety of tools for making sense of data. To learn about other chart types, check out this index of data tips.

Active Ingredients (What is a cycle plot?)

A cycle plot shows how a trend or cycle changes over time. We can use them to see seasonal patterns. Typically, a cycle plot shows a measure on the Y-axis and then shows a time period (such as months or seasons) along the X-axis. For each time period, there is a trend line across a number of years. In the example below, we see that, on average (black lines show averages across years), there were the most travelers from Greece in August between 2001 and 2011, but we can also see that the number of travelers varied greatly from year to year. Use the filter to see trends for travelers from other countries.

Source: Travellers by Month Cycle Plot by Tai Shi Ling on Tableau Public

Uses

Cycle plots can help identify periods of time when the best or worst results are recorded. For example, you want to see trends in participation in your summer programs or patterns in year-end giving over the years. Cycle plots can be created in a number of data viz applications including Excel and Tableau.

Warnings

The range of years shown in each trendline can be shown on the X-axis or in the subtitle to the the chart, but the range should be clear and consistent across trendlines.

Fun Fact

William S. Cleveland and Irma J. Terpenning introduced the cycle plot in Graphical Methods for Seasonal Adjustment (1982) In their example below, we see that number of telephone installations are highest in late summer/early fall.

To see past data tips, including those about other chart types, scroll down or click HERE.

Title Image Source: Seasonality with Cycle Plots by Vladimir Trkulja on Tableau Public

Let’s talk about YOUR data!

Got the feeling that you and your colleagues would use your data more effectively if you could see it better? Data Viz for Nonprofits (DVN) can help you get the ball rolling with an interactive data dashboard and beautiful charts, maps, and graphs for your next presentation, report, proposal, or webpage. Through a short-term consultation, we can help you to clarify the questions you want to answer and goals you want to track. DVN then visualizes your data to address those questions and track those goals.

10 Essential Data Facts For Non-Data People: The Cheat Sheet

Reposted from January 2022

Here are ten data facts for non-data people who, nevertheless, have to deal with data sometimes (i.e. most of us). This is the cheat sheet. Click on the “Learn More” buttons for additional information served up in comic strip format!

Let’s talk about YOUR data!

Got the feeling that you and your colleagues would use your data more effectively if you could see it better? Data Viz for Nonprofits (DVN) can help you get the ball rolling with an interactive data dashboard and beautiful charts, maps, and graphs for your next presentation, report, proposal, or webpage. Through a short-term consultation, we can help you to clarify the questions you want to answer and goals you want to track. DVN then visualizes your data to address those questions and track those goals.

The Power of Substraction

“Perfection is achieved, not when there is nothing more to add, but when there is nothing left to take away.”

―Antoine de Saint-Exupéry, Airman's Odyssey

If you have heard of any data viz guru, it’s probably Edward Tufte. And if you know one thing about Tufte, it’s probably the data-to-ink ratio. The data-to-ink ratio is the amount of ink (or pixels) that convey the data divided by the total ink (or pixels) used in the entire chart. The ratio, according to Tufte, should be as close to one as possible. In other words, most of the ink/pixels should be conveying data, and you should remove as much non-data ink/pixels as possible. Click through Joey Cherdarchuk’s slides below for a great example of what Tufte is talking about.

Source: Darkhorse Analytics

To see past data tips, click HERE.

Let’s talk about YOUR data!

Got the feeling that you and your colleagues would use your data more effectively if you could see it better? Data Viz for Nonprofits (DVN) can help you get the ball rolling with an interactive data dashboard and beautiful charts, maps, and graphs for your next presentation, report, proposal, or webpage. Through a short-term consultation, we can help you to clarify the questions you want to answer and goals you want to track. DVN then visualizes your data to address those questions and track those goals.

Presenting Data Fast and Slow

Reposted from May 2022

Sometimes we approach the challenge of sharing data with others as if we were trying to con a pet into taking a pill. We think that our audience is too busy, disinterested, or distracted to focus on the data. So we wrap it in something that attracts their attention and feed it to them as quickly as possible. The problem with this approach is that it may get the data into their brains—momentarily—but it won’t stay there long. See where the pill ends up in this video.

If we want others to LEARN from the data — which involves not only retaining it but also drawing knowledge from it and applying that knowledge in the future — then we need a different approach. Daniel Kahneman’s Thinking Fast and Slow can help us.

First a little background on how the brain works, according to the evidence Kahneman presents. For learning to happen, information first must get past System 1 of our brains. This is where fast thinking happens. System 1 is the harried gate keeper, madly processing all of the information that comes in through our senses, pitching most of it, keeping only what is deemed necessary. But making it through the gate is only half the battle. Once in, information confronts System 2. This is the part of the brain that allows for conscious thought or slow thinking. The problem is that System 2 is lazy. Conscious thought is hard, and System 2 is always looking for an excuse to avoid it. However, if System 2 engages with information, the resulting knowledge can find its way to long-term memory and learning happens.

So the challenge when presenting data is to make it past System 1 AND engage System 2. Let’s consider a series of vizes from Harvard Business Review (HBR) that I think meets both parts of this challenge. Yes, it’s an example from the for-profit world, but could easily work with nonprofit data. See snapshot of the first viz in the series below .

How to get data past System 1

Getting data past the System 1 fast-thinking gate keeper is all about grabbing attention. We process images much more quickly than words and numbers, so images are a great foot-in-the-door. The HBR viz does it with bright colors and a cool-looking, somewhat unusual chart. There’s plenty of information out there about how to attract attention, including the use of images with:

  • Stand out colors and textures

  • Human faces (we are wired to focus on them)

  • Novelty (images that are unusual in size, placement, etc.)

Data visualizations can use color as well as images to draw attention. But getting past System 1 is not nearly enough. For learning to happen, the viz also has to engage System 2.

How to engage System 2

System 2 is smart but lazy. So we need to pique its interest. The HBR viz starts with a title that poses a question. When confronted with an interesting question, we may be more likely to stick around for an answer. Then the viz leads you through the answer in a visually engaging way (see interactive version of the viz HERE). These are two great ways to slow down and engage the brain with data. Here’s a list of ways to engage System 2:

  • Ask a question in the title as the HBR viz does—questions beg answers.

  • Make it personal. We may be more likely to engage with data when we have a personal connection with it. This New York Times viz, for example, allows you to enter in your county to see what the barriers to COVID vaccination are in your area.

  • Highlight a surprising finding. Many of us love the counterintuitive and the creative. If you draw attention to something new that the data suggests, you may have a better chance at hooking System 2. For example, this viz from The Economist shows that China emits far less greenhouse gas per person than Western countries at the same stage of economic development. Or check out this viz by Dimiter Toshkov showing that small countries can be big players in development and good governance.

  • Hand draw it. There is some evidence that making information harder to consume, for example by presenting it with harder-to-read fonts, makes the brain slow down and engage in effortful and analytic processing. Although the jury is still out on this, I do find myself more likely to engage in hand-drawn vizes like two of the winners of the World Data Visualization Prize in 2019. Perhaps it’s simply the novelty of hand-drawn charts that engages me. Anyway, it’s something you might consider, and all you need is a pen and paper.

  • Walk them through it. A great way to slow down your viewers is to set the pace by walking them through the data as HBR does in the example. I love how HBR presents what the data might look like if our assumptions were confirmed followed by what it actually looks like.

Sources: Veritasium, Visual Content Space, MIT News, Springer Link,

Let’s talk about YOUR data!

Got the feeling that you and your colleagues would use your data more effectively if you could see it better? Data Viz for Nonprofits (DVN) can help you get the ball rolling with an interactive data dashboard and beautiful charts, maps, and graphs for your next presentation, report, proposal, or webpage. Through a short-term consultation, we can help you to clarify the questions you want to answer and goals you want to track. DVN then visualizes your data to address those questions and track those goals.

Don't Measure Impact . . . Wait, What?

Reposted from September 2022

Ghost of Christmas Yet To Come in The Chrismas Carol by Charles Dickens, Illustration by J. Leech, Source: Flickr

Most organizations should not waste time and money on impact evaluations. Measuring impact is difficult and expensive. It’s difficult because you need a good counterfactual. A counterfactual is what Dickens’s Ghost of Christmas Yet to Come shows Ebenezer Scrooge: what would happen if you did not change anything. The impact of an intervention or program is the difference between what happened and what would have happened without the intervention. Since, in the real world, you can’t observe the same group of beneficiaries with and without the intervention (as we do when we watch The Christmas Carol), you need a good proxy for the would-have-been condition. The best proxy is a group of potential beneficiaries that were randomly selected from a larger group of potential beneficiaries. These folks do not get the intervention. Then you can compare those who did and did not receive the intervention over time to estimate the impact of the intervention. This is called a randomized control trial or RCT.

Of course, withholding an intervention from potential beneficiaries can be a difficult and morally-questionable pursuit. And tracking a large group of beneficiaries and non-beneficiaries over time is expensive. This usually requires a team of skilled data collectors and analysts. Non-randomly-selected comparison groups are not nearly as good because they may differ from the intervention group in known or unknown ways. So it’s difficult to determine if the outcomes observed are due to the intervention itself or to pre-existing biases or characteristics. This costly and challenging process is further complicated by the need to start with a well-established intervention, one that has already worked out the kinks.

Due to the many challenges of measuring impact, most organizations should not waste time and money on impact evaluations. Instead, they should consider interventions that already have a strong research base, ideally because they have been rigorously tested with RCTs. (Check out: Where to Search for Evidence of Effective Programs.)

In a Stanford Social Innovation Review article, Mary Kay Gugerty and Dean Karlan suggest that, before beginning a new program, organizations ask: “What do other evaluations say about it? How applicable is the context under which those studies were done, and how similar is the intervention? Study the literature to see if there is anything that suggests your approach might be effective.”

Rather than assessing impact, your limited resources are better spent assessing implementation. You can do this by collecting data that shows whether what you planned is actually happening. If you can pinpoint where the problems are, you are in a better position to make fixes, alter plans, refine processes.  Many organizations make their plans using a logic model (aka theory of change). A logic model is a flow chart with inputs and outputs. The best logic models draw on past impact evaluations to determine what inputs are most likely to lead to what outputs. And organizations can easily assess progress to date by plugging their logic models into real time data. Interested? Read more about “living logic models” HERE.

To see past data tips, click HERE.

Let’s talk about YOUR data!

Got the feeling that you and your colleagues would use your data more effectively if you could see it better? Data Viz for Nonprofits (DVN) can help you get the ball rolling with an interactive data dashboard and beautiful charts, maps, and graphs for your next presentation, report, proposal, or webpage. Through a short-term consultation, we can help you to clarify the questions you want to answer and goals you want to track. DVN then visualizes your data to address those questions and track those goals.

It's Love Data Week!

What’s that?

Love Data Week is an international celebration of data, taking place every year during the week of Valentine's Day. Nonprofit organizations, universities, government agencies, corporations and individuals are encouraged to host and participate in data-related events and activities.

What’s in it for me?

Lots of free online events, many of which are relevant to nonprofit work such as workshops on data visualization, infographics, data resources, data privacy, etc. See a full list of events HERE.

Where can I learn more?

HERE.

To see past data tips, click HERE.

Let’s talk about YOUR data!

Got the feeling that you and your colleagues would use your data more effectively if you could see it better? Data Viz for Nonprofits (DVN) can help you get the ball rolling with an interactive data dashboard and beautiful charts, maps, and graphs for your next presentation, report, proposal, or webpage. Through a short-term consultation, we can help you to clarify the questions you want to answer and goals you want to track. DVN then visualizes your data to address those questions and track those goals.

How and Why to Visualize Variability

Every dataset includes variability. The people and things we measure differ from one another in many ways. And visualizing data always involves some decisions about how much of that variability to show. There are tradeoffs:

  1. If you show too much variability, you obscure patterns and trends. To understand anything with data, we usually need to reduce its complexity. We can’t extract meaning from a table full of numbers and letters. So we summarize the data through such activities as grouping people, concepts, and time periods; calculating averages; or organizing individuals or groups in a rank order. This process allows us to detect patterns and trends within the data. Patterns and trends become even more apparent when we visualize the data in the form charts, maps, and graphs by assigning visual cues such as color, size, and shape to groups and values. However, too many colors, sizes, and shapes make discerning the patterns and trends more difficult.

  2. If you show too little variability, you obscure reality*. Overly simplified visualizations do not show just how complex and messy the data actually is. And the viewer may mistake the simplified, summarized version of the data as reality.

You can find a great example of problem #2 in Eli Holder’s article Divisive Dataviz: How Political Data Journalism Divides Our Democracy. He describes the danger of red and blue political maps in the U.S. in this way: “there’s no such thing as a “red state” or a “blue state.” Consider Texas, which is often called a “red” state. In the 2020 presidential election, more Texans voted for Joe Biden (5.26 million) than every other “blue” state, except for California. Even New York, a Democratic stronghold, had roughly 20,000 fewer Biden voters than Texas. . . . While popular election maps accurately reflect the ‘winner-take-all’ dynamic of the electoral college, they create the misimpression that state electorates are monolithic blocks of only-Republicans or only-Democrats.”

And the misimpressions such maps engender have real-world consequences. Holder describes an experiment in which people were shown either dichotomous maps or continuous maps (see examples below). Those shown dichotomous maps were more likely than those shown continuous maps to feel that their state was dominated by one party and thus that their votes mattered less because the election outcome was a foregone conclusion.

So when deciding how many shades of gray or circle sizes to show, consider how much summarization is needed to make patterns and trends perceptible without misleading the viewer with an oversimplified view of the data. Take, for example, these three versions of a map. They each show the same CDC chronic illness survey data with a “diverging color palette” in which blue states ranked high on health indexes; orange states ranked low; and gray states were in the middle. The maps differ in the degree of variability shown. Which map allows you to see corridors of good and bad health without oversimplifying the matter?

*More specifically, the full reality of the data. This 60-second data tip doesn’t get into the nature of reality in general!

To see past data tips, click HERE.

Let’s talk about YOUR data!

Got the feeling that you and your colleagues would use your data more effectively if you could see it better? Data Viz for Nonprofits (DVN) can help you get the ball rolling with an interactive data dashboard and beautiful charts, maps, and graphs for your next presentation, report, proposal, or webpage. Through a short-term consultation, we can help you to clarify the questions you want to answer and goals you want to track. DVN then visualizes your data to address those questions and track those goals.