13.2 Deliberative Polling

Another approach to getting groups of people to come together to make decisions, in a process where the integration of facts and values is scaffolded.

The Lesson in Context

Near the end of the course, we introduce some techniques for group decision making that have seen some real-world success. Deliberative polling is one such method that allows citizens to make a democratic decision on some policy option in accordance with their values but with the knowledge of experts at their disposal.

We have a panel and topic every year. So, the substance of this lesson can change quite substantially. Much of what's written here is an example based on what was used in UC Berkeley's Spring 2023 iteration of the course.

Relation to Earlier Lessons

1.1 Introduction and When Is Science Relevant

Students are familiar with the tension between facts in an epistocracy and values in a democracy. The primary purpose of a deliberative poll is to resolve this conflict by giving members of the general public access to the narrow expertise needed for some difficult policy decision.

7.1 Causation, Blame, and Policy

Deliberative polling may be able to help resolve the issues of status quo bias in policy making. It does so by forcing people to carefully consider a wider array of policy options as well as the implications and consequences of each.
However, people are not immune to their other biases just because they're in a deliberative poll. Omission bias can still be a strong motivator in determining which policy the members of the public select.

10.1 Confirmation Bias

Selective exposure can be addressed by deliberative polling since all the participants (both members of the general public and experts) are forced to be exposed to multiple sides of whatever policy they're debating.
Deliberative polling does not necessarily help with biased assimilation.

13.1 Denver Bullet Study

In the Denver Bullet Study method, the final recommendation is provided by experts to match the values put forth by various stakeholders. The citizens don't need to know about the technical details at all. All they have to worry about are the values. In deliberative polling, the experts are there to inform the general public who are integrating facts and values for themselves.

Takeaways

After this lesson, students should

Be optimistic about the possibility of integrating the perspectives and insights of both experts and stakeholders in forming effective policies with community buy-in.
Recognize problems which could be resolved effectively using deliberative polling.

Deliberative Polling

A system of decision-making wherein a representative group of stakeholders come together, exchange and discuss information, question experts, and poll their individual opinions at various points throughout the session.

Participants are not required to come to an agreement.
Participants are asked to speak to the facts presented in the briefing material, rather than try to convince other group members of their position.
Experts are only there to answer questions posed by participants, rather than try to convince people of their own position.
Each small group is moderated by a neutral moderator.

Deliberative Democracy Lab

The group that first developed deliberative polling.

America One Room Experiment

New York Times article on the success of a Texas deliberative polling event.

Useful Resources

Discussion Slides Template

The discussion slides for this lesson.

Deliberative Polling Moderator Guide

Instructions for moderators to read prior to deliberative polling.

Student Questions Spreadsheet Template

Spreadsheet for keeping track of students' questions over many rounds of deliberation.

Example Pre-poll Form

Pre-poll Google form that was used in UC Berkeley's Spring 2023 iteration of the course.

Example Post-poll Form

Post-poll Google form that was used in UC Berkeley's Spring 2023 iteration of the course.

Misinformation Briefing Materials

Example briefing materials. These were used for UC Berkeley's Spring 2023 iteration of the course.

Gene Drives Briefing Materials

Example briefing materials. These were used for UC Berkeley's Spring 2022 iteration of the course.

Recommended Outline

Before Class

Developing a Topic

Deciding on a Topic

The following are some desiderata for a good deliberative polling topic for SSS.

The topic has wide societal relevance.
The topic involves understanding some technical background, which can be provided by the briefing material and the expert panel.
There is a range of policy options on which it is possible to find experts who would make different policy recommendations.
Students either do not yet hold a strong opinion on the topic, or are divided in their policy choices.

To determine the range of expert opinions, it is necessary to contact some relevant experts by email or phone for a conversation.

To determine the range of student opinions, a preliminary poll may be sent out to ask students to choose a policy option for each of several candidate topics.

Writing the Briefing Materials

The briefing material should give a short review (15-20 pages) of the societal and historical context of the issue, the relevant technical background, and various policy options, as well as their pros and cons. It should be written by the teaching staff long ahead of the event and reviewed by at least one relevant expert for accuracy and comprehensiveness.

Misinformation Briefing Materials

Example briefing materials. These were used for UC Berkeley's Spring 2023 iteration of the course.

Gene Drives Briefing Materials

Example briefing materials. These were used for UC Berkeley's Spring 2022 iteration of the course.

Recruiting Experts

A list of relevant experts for each topic should be compiled at least three months ahead of the event. They may be from the Bay Area and invited to join in person, or beyond and invited to join virtually. While the net should be cast wide initially, a final panel of 4 to 6 experts should be assembled to maximize the range of opinions represented. We have typically asked some of the experts to take on a position that they do not personally take, with a friendly disclaimer announced at the beginning of the event. Some of the experts should be contacted early on to get their input on the range of opinions and the quality of the briefing materials.

Recruiting Moderators

Several rounds of deliberation will be conducted in groups of 10 students. Two rounds will occur during discussion section (~30 students each), and two more rounds during plenary with an expert panel. During each round of deliberation, every group will be moderated by a moderator. Course staff members should all be recruited, if available. Former course staff members and top performing former students can also be invited to be volunteer moderators. The faculty should not serve as moderators so as to allow students to speak more freely. Some reserve moderators should be prepared in case some moderators have to drop out at the last minute.

Expectations for Moderators

Once the team of moderators has been assembled, it is important to hold a short briefing session. The moderators are explained the following expectation:

Be familiar with the content of the briefing material ahead of the event.
Bring their laptop to write down questions during deliberation.
Introduce themselves and start a short round of introduction around the group.
Moderate the amount of time each member of the group speaks by politely cutting off dominating members and inviting opinions from quieter ones, e.g. "We have heard from some of our members. Would others like to add to that?"
Refer the group to particular sections of the briefing material when there is factual disagreement between members.
Refrain to expressing the moderator's own opinion on the subject.

Deliberative Polling Moderator Guide

Instructions for moderators to read prior to deliberative polling.

Immediate Class Preparation

Host a moderator training session.
Everyone needs to have read the briefing materials.
Coordinate with any extra moderators for your class section.
Make a pre-poll form.
Make a post-poll form.
Make a spreadsheet to put student questions on.

During Class

9 Minutes	Whole class review of deliberative polling and the briefing materials.
1 Minute	Give the students the pre-poll form and have them do it.
30 Minutes	Run the practice round of deliberation.
10 Minutes	Break and chance to read briefing materials for answers.
30 Minutes	Run the first real round of deliberation.

After Class

Compile the questions and make sure it's clear which students are asking them.
Someone will go through the questions and decide which ones to ask.

Lesson Content

Deliberative Polling Review

An instructor reviews how deliberative polling works in the real world and explains the deliberative polling agenda.

The specifics of your deliberative polling schedule will depend a lot on how your course is structured, when you can get guests, and when your course times are. What's written here is one version that's been used previously.

A possible version of the schedule:

Section
1. Pre-poll survey.
2. Practice round of deliberation.
3. Review the briefing materials to see what question we can answer.
4. First real round of deliberation.
Between section and lecture
1. Someone selects questions.
Lecture
1. First panel discussion with the experts.
2. Second round of deliberation.
3. Someone selects questions.
4. Second panel discussion with experts.
5. Third round of deliberation.
6. Maybe a third panel discussion with experts.
7. Post-poll survey.
8. Compare results of the pre- and post-poll surveys with the experts present.

Pre- and Post-poll Forms

In order to know how students' opinions change, we need to survey their thoughts before and after conducting the deliberative poll. This should be done before they even read the briefing materials and at the very end of the entire process. It doesn't need to be done between each round of deliberation.

Example Pre-poll Form

Pre-poll Google form that was used in UC Berkeley's Spring 2023 iteration of the course.

Example Post-poll Form

Post-poll Google form that was used in UC Berkeley's Spring 2023 iteration of the course.