13.1 Denver Bullet Study: Difference between revisions

From Sense & Sensibility & Science
(// Edit via Wikitext Extension for VSCode)
(// Edit via Wikitext Extension for VSCode)
Line 49: Line 49:


</tabber>
</tabber>
<restricted>


== Useful Resources ==
{{#restricted:{{13.1 Denver Bullet Study}}}}{{NavCard|prev=12.2 Grill the Guest|next=13.2 Deliberative Polling}}
 
<tabber>
 
|-|Lecture Video=
 
<br /><center><youtube>Qs6kZ0dv_Ec</youtube></center><br />
 
|-|Discussion Slides=
 
{{LinkCard
|url=https://docs.google.com/presentation/d/1ceysMd4bCqIbLsDOmZEsAvyxNvrhApdASCAIVpASFlU/
|title=Discussion Slides Template
|description=The discussion slides for this lesson.
}}
<br />
 
|-|Handouts and Activities=
 
{{LinkCardInternal
|url=:File:13.1 Denver Bullet Study - Worksheet.pdf
|title=Glorin-Fuilder Fireworks Study Handout
|description=Handout for all parts of the Glorin-Fuilder fireworks study activity.}}
<br />
 
|-|Readings and Assignments=
 
{{LinkCardInternal
|url=:File:Science, Values, and Human Judgment - Hammond, Adelman.pdf
|title=Science, Values, and Human Judgment
|description=Original paper outlining the Denver Bullet Study.}}
<br />
 
</tabber>
 
== Recommended Outline ==
 
=== Before Class ===
 
Print out one copy of the handout for each student.
 
=== During Class ===
 
{| class="wikitable" style="margin-left: 0px; margin-right: auto;"
|5 Minutes
|Come up with some fun way to assign the roles of spokesperson and notetaker (e.g. earliest birthday in the year, lives furthest from campus). Remind them of the responsibilities of these roles.
|-
|10 Minutes
|Go through the [[#Review Questions|review questions]].
|-
|20 Minutes
|Have the students work through [[#Part 1: Diagraming the Study|part 1]] of the Glorin-Fuilder study.
|-
|20 Minutes
|Have the students work through [[#Part 2: Finishing the Study|part 2]] of the Glorin-Fuilder study.
|-
|20 Minutes
|Lead the students through the [[#Campus Development|campus development]] discussion.
|-
|5 Minutes
|Have the students answer the [[#Final Questions|final questions]].
|}
 
== Lesson Content ==
 
=== Review Questions ===
 
[[File:Denver Bullet Study Diagram.png|thumb|A diagram of the Denver Bullet Study process.]]
<ol start=1><li>Should we just let experts make all the decisions in society? Why or why not?</li></ol>
{{BoxAnswer|We ''could'' let experts make all the decisions. Presumably, since they're experts, they would make more optimal decisions than non-experts. The question is what are they optimizing ''for''. If we want the general public to have a say in that, then they need a role in our decision-making processes.}}
<ol start=2><li>What is the role of values in the Denver Bullet Study?</li></ol>
{{BoxAnswer|In the Denver Bullet Study, experts identified different qualities that bullets could have (such as "injury" or "stopping effectiveness"). The different stakeholders assigned different weightings to those qualities depending on which of them they valued having in the selected bullets.}}
<ol start=3><li>What is the role of facts in the Denver Bullet Study?</li></ol>
{{BoxAnswer|There are lots of roles for facts. The main one is in the weighting of different fundamental attributes of the bullets (such as "weight" or "nuzzle velocity") to different resulting qualities (such as "injury" or "stopping effectiveness").}}
<ol start=4><li>How does the Denver Bullet Study synthesize facts and values in arriving at a group decision?</li></ol>
{{BoxAnswer|It separated the analysis of facts about what bullets would have what effects from the weighting of values about what effects the stakeholders care about. In this way the experts spoke only on the facts of the decision and the stakeholders spoke only on the values.}}
<ol start=5><li>Suppose all policy decisions were made in a process like the Denver Bullet Study. Would such a country be a democracy or an epistocracy?</li></ol>
{{BoxAnswer|This is a little bit of a trick question. It would have attributes of both!}}
<ol start=6><li>Where do the values, facts, and synthesis appear on the diagram of the Denver Bullet Study?</li></ol>
{{BoxAnswer|[[File:Denver Bullet Study Components.png|frame]]}}
=== Part 1: Diagraming the Study ===
 
==== Background ====
 
[[File:Glorin-Fuilder Study Diagram.png|thumb||A potential diagram of the Glorin-Fuilder Study process.]]
Suppose you are the advisor to Prince Kumperdinck of Glorin, who is trying to develop an agreement with the neighboring nation, Fuilder.
 
The bakers of Glorin, who live close to the Glorin-Fuilder border, have been repeatedly disrupted by Fuilder's tendency to launch loud, bright fireworks late at night (this makes it difficult for the bakers to get up early to prepare the day's bread). The bakers of Glorin believe that the residents of Fuilder should only be allowed to use small, silent sparklers, such as the “Warm Greetings."
 
The residents of Fuilder consider this solution inconceivable, because launching true fireworks each night is part of their cultural tradition and helps maintain the happiness of the nation. They have been using the “Fire Tornado” for over 100 years since its invention and they don't want to relinquish such flamboyance that represents their culture.
 
There is rising tension between the citizens of Glorin and Fuilder, as neither side is willing to back down. Thinking back to your favorite class in advisor school, you recall a decision-making technique that involved integration of facts and values to come to a compromise in a similar scenario (the Denver Bullet Study). Prince Kumperdinck puts you in charge of implementing this technique. Your hope is that you can select a kind of firework that will satisfy both parties as much as possible.
 
==== Questions ====
 
# Suppose you are a citizen of one of the two towns. What are some of the factors of these fireworks that you might be concerned about?
# The actual citizens of Glorin and Fuilder have been polled on this question. It turns out that the two dominant factors they care about are loudness and brightness. Create a diagram based on the one used for the Denver Bullet Study.
 
Stakeholders make a list of factors they care about. These are the boxes in column two. The stakeholders assign weights based on how much they care about each of these factors. Then experts make a list of measurable quantities that contribute to the factors the stakeholders are concerned with. These are column one. The experts are blinded as to how much the stakeholders care about each of the items in column two. Then ''you'' determine the best final outcome.
 
=== Part 2: Finishing the Study ===
{{BoxCaution|Students are often surprised by the need to do arithmetic in this lesson. Make sure to remind them of the meaning of the numbers on the handout and be on the lookout for anyone that seems lost.}}
==== Discuss Relevant Stakeholders ====
 
Discuss who the relevant stakeholders and experts are in this situation and describe their roles in the decision-making process. (Note: you are not inventing a decision-making process. You are implementing the process discussed in class for integrating facts and values, exemplified by the Denver Bullet Study.)
 
Now that you have the different criteria for the fireworks, you decided to conduct a survey among the citizens to get their preferences of each criteria. You ask them on a scale of -10 to 10, how much they like loud or bright fireworks. 10 is the highest preference while -10 is the lowest preference, and 0 is neutral. A negative number would indicate that they hate loud/bright fireworks. The results of the survey are tabulated below.
 
{| class="wikitable" style="margin-left: auto; margin-right: auto"
|+Citizen's preference based on a survey you conducted:
|-
|
|Goodness of Loudness
|Goodness of Brightness
|-
|Average Fuilder
|1
|10
|-
|Average Glorin
|&minus;10
|1
|}
{{BoxTip|We have a negative value because people in Fuilder really hate loud fireworks. They would strongly prefer the opposite of loudness.}}
At the same time, your colleague spent time with the firework experts and got some physical measurements of the available fireworks. The numbers are normalized so that 10 means the most loud/bright and 1 means the least loud/bright. The results are tabulated below.
 
{| class="wikitable" style="margin-left: auto; margin-right: auto"
|+Available fireworks measured by experts:
|-
|
|Loudness Measured
|Brightness Measured
|-
|Fire Tornado
|8
|10
|-
|Warm Greetings
|2
|3
|-
|Happy Flower
|5
|6
|-
|Dancing Butterfly
|4
|9
|}
 
==== Complete the Table ====
 
{| class="wikitable" style="margin-left: auto; margin-right: auto"
|+Total goodness table:
|-
|
|Total Goodness for Fuilder
|Total Goodness for Glorin
|Total Goodness for All
|-
|Fire Tornado
|{{Correct|108}}
|{{Correct|-70}}
|{{Correct|38}}
|-
|Warm Greetings
|{{Correct|32}}
|{{Correct|-17}}
|{{Correct|15}}
|-
|Happy Flower
|{{Correct|65}}
|{{Correct|-44}}
|{{Correct|21}}
|-
|Dancing Butterfly
|{{Correct|94}}
|{{Correct|-31}}
|{{Correct|63}}
|}
 
<ol start=1><li>Use the preferences given (see the two tables in the previous section) to fill out the "total goodness" table.</li></ol>
<ol start=2><li>Which firework would you choose if you are a person from Fuilder? Which would you choose if you are from Glorin?</li></ol>
{{BoxAnswer|Fuilder like Fire Tornado. Fire Tornado BIG. Glorin like Warm Greetings. Warm Greetings smol.}}
<ol start=3><li>Which firework would you choose as an advisor for the prince?</li></ol>
{{BoxAnswer|Kumperdinck like Dancing Butterfly. Dancing Butterfly politically optimal for maintaining tenuous grip of power over the worthless peons ruled over.}}
<ol start=4><li>Explain how this technique produces/outputs an optimal type of firework.</li></ol>
{{BoxAnswer|By assigning numerical scores to all the values and finding the result that is most preferred. This seems very utilitarian. But, the nice thing is that it allows all the stakeholders to define ''their own'' utility function. In a real case you likely assign the value scores by giving people certain amounts of points to distribute. This helps bound people's values in a practical way.}}
=== Campus Development ===
{{BoxCaution|This discussion was written specifically for UC Berkeley. You may want to switch it out for something more relevant to your students.}}
There are talks of developing the Oxford Field Track (a large plot of land owned by UC Berkeley in Northside near downtown). It currently holds farms, greenhouses, and other research facilities for the College of Natural Resources. Suppose you are a campus administrator tasked with using a method like that of the Denver Bullet Study to determine which of the following development proposals to adopt.
# Leave the land as is for CNR.
# Build high density student housing on it.
# Turn the land into a public park.
# Build academic buildings to hold classrooms and offices.
Following the Denver Bullet Study method, answer the following questions in small groups.
# Who are the stakeholders?
# Who might the experts be?
# List some positive and negative consequences of the above plans that the stakeholders might value.
# How might the experts determine the consequences of each proposal?
 
=== Final Questions ===
 
* What is a potential policy decision that you ''should not'' decide with a Denver Bullet Study method?
* What's a current or former policy proposal that ''would'' benefit from a Denver Bullet Study style decision?</restricted>{{NavCard|prev=12.2 Grill the Guest|next=13.2 Deliberative Polling}}
[[Category:Lesson plans]]
[[Category:Lesson plans]]

Revision as of 00:16, 22 August 2023

Topic Cover - 13.1 Denver Bullet Study.png

The Denver Bullet Study offers one approach to integrating facts and values in a controversial real-world problem, drawing facts from a set of experts, gauging the values of different stakeholders, and bringing these together for a final decision.



The Lesson in Context

Near the end of the course, we introduce some techniques for group decision making that have seen some real-world success. Denver Bullet Study exemplifies the division of a contentious issue into facts and values in such a way that the community was able to come to a more generally satisfying decision than initially seemed possible.

1.1 Introduction and When Is Science RelevantTopic Icon - 1.1 Introduction and When Is Science Relevant.png
  • Facts and values of an issue are distinguished in the Denver Bullet Study method. Facts are evaluated by experts, while values are decided by polling stakeholders.
5.2 Scientific OptimismTopic Icon - 5.2 Scientific Optimism.png
  • Even as the public seem to have reached an impasse on a contentious issue, there are still techniques that can be used to reach a consensus, or at least find a solution that addresses the priorities of a larger number of stakeholders.
13.2 Deliberative PollingTopic Icon - 13.2 Deliberative Polling.png
  • Another technique for group decision making in which experts and stakeholders are involved and facts and values are distinguished. Through group deliberation punctuated by Q&A with an expert panel, it aims to predict the change in public opinion if the public were to be more factually informed on a contentious issue, but it does not aim to reach a consensus or directly decide on a policy.


Takeaways

After this lesson, students should

  1. Be optimistic that a community can come together to make a decision, even when people begin with heterogeneous values and beliefs.
  2. Be able to identify the stakeholders and experts and distinguish between the values and facts of an issue.

Stakeholders

The set of people who have a stake in the outcome of a decision. This can include people who will implement the decision and all the people affected by it.

Experts

The set of people who have the most knowledge/information/expertise about the facts relevant to the decision, generally by virtue of having spent the most time and effort learning about the topic.

Denver Bullet Study

An experiment in group deliberation in which a community came together to share values and knowledge to make a decision about what kind of bullet the Denver Police should use, which had enough stopping power to keep cops safe but was not so harmful as to cause unnecessary damage to citizens (as did classic hollow bullets).

The town should vote on whether they think these windmills kill seabirds or cause loud noise.

These are factual factors that most stakeholders (townspeople) would not have informed opinions on. Instead, they should be evaluated by relevant experts. Stakeholders can then vote (or put numerical weights) on how much they value the lives of seabirds or quietness.

We should just let the experts make all the decisions.

It is important to involve the public (or relevant stakeholders) in making group decisions, as factual evaluation must be combined with a group's values judgment (of what they deem important). Experts can give their evaluation of factual matters, but they may not represent the values of the stakeholders.

Additional Content

You must be logged in to see this content.