Criteri1
docx
keyboard_arrow_up
School
San Francisco State University *
*We aren’t endorsed by this school
Course
211
Subject
Information Systems
Date
Nov 24, 2024
Type
docx
Pages
3
Uploaded by DrMetalLark11
Criteria: Completeness
Definition: The extent to which the information presented is accurate, reliable, and aligns with
established facts or evidence
Good Example: "A complete response includes all stages of the water cycle and explains each one
briefly."
Bad Example: "Water evaporates, and then it rains."
Why: The good example provides a full explanation, whereas the bad example is missing several stages.
We will be using a detailed rubric to guide our evaluation process. The rubric divides the assessment of
accuracy into three tiers:
Prompt Request Coverage: The degree to which the response fully addresses and satisfies the explicit
questions or requirements posed by the initial prompt. For prompt: "Discuss the health impacts and
socioeconomic consequences of air pollution.", here is a good and bad example:
Good Example"The health impacts of air pollution include respiratory diseases, cardiovascular damage,
and reduced life expectancy. Socioeconomic consequences encompass increased healthcare costs and
lost labor productivity."
Explanation: This response is good because it directly addresses both the health and socioeconomic
aspects of the prompt about air pollution, ensuring a comprehensive answer.
Bad Example: "Air pollution is harmful to the environment."
Explanation: This is a bad response because it fails to address the specific aspects of the prompt about
health and socioeconomic consequences, thus it is incomplete.
Constraints: Limitations or conditions that are specified within the prompt which must be adhered to
when formulating a response or solution. For prompt: "Plan an environmentally friendly and budget-
conscious event that aligns with our organization's green policies.", here is a good and bad example
Good Example "Our event plan will only use locally sourced food and biodegradable materials to stay
within the budget and eco-friendly guidelines you’ve set."
Explanation: This response is good because it addresses the constraints by outlining solutions that
adhere to the budget and eco-friendly requirements.
Bad Example:"To make the event memorable, we’ll have exotic foods flown in from around the world
and use the most impressive plastic decorations available."
Explanation: This response is bad because it completely ignores the constraints of local sourcing and eco-
friendliness, focusing instead on impressiveness without regard to the given limitations.
Breadth of Solutions [STEM]: The range or variety of different solutions, methods, or approaches
discussed in the response that pertain to solving a problem or addressing a question. For prompt
"Propose a comprehensive cybersecurity strategy for a small business to protect against various types of
cyber threats.", here is a good and bad example:
Good Example"To combat cyber-attacks, we should employ a combination of encryption, two-factor
authentication, regular security audits, and ongoing staff training on security best practices."
Explanation: This is a good response because it demonstrates a breadth of solutions that are
comprehensive and varied, addressing different aspects of cybersecurity.
Bad Example: "To stop cyber-attacks, just install antivirus software."
Explanation: This response is bad because it shows a lack of breadth, suggesting only a single, simplistic
solution to a complex problem that requires a multifaceted approach.
Criteria Completion - Putting it all Together
Example Breakdown for prompt "Describe the impact of remote work on company culture and employee
productivity."
For this prompt, the completeness of the response would be evaluated based on how thoroughly it
covers the various aspects of company culture and employee productivity, such as communication,
teamwork, work-life balance, and employee engagement.
Insufficient (1-2): "Remote work can make employees feel isolated."
Prompt Request Coverage: This response only partially covers the prompt because it addresses a single
negative aspect of remote work's impact on employees and omits any discussion of company culture or
the full range of productivity issues.
Constraints: The statement complies with the constraints by not introducing unrelated topics; however,
it fails to address all constraints of the prompt, which includes the discussion on company culture.
Breadth of Solutions [STEM]: No solutions or suggestions are provided to mitigate the issue of isolation,
nor are there any positive impacts or productivity elements mentioned, so the response lacks breadth.
Minimum (3):
"Remote work can improve employee productivity due to less commuting time but may
also harm company culture by reducing in-person interactions."
Prompt Request Coverage: This response addresses two critical aspects of the prompt – productivity
gains through less commuting and the potential harm to company culture through reduced interactions.
Constraints: It respects the prompt's constraints by staying focused on the impact of remote work on
company culture and productivity.
Breadth of Solutions [STEM]: Although it does not provide specific solutions, it presents a balanced view,
showing both a positive and negative impact, which aligns with the criteria for a minimum level of
completeness.
Good (4-5): "The shift to remote work has a complex impact: it can enhance employee productivity by
allowing for a flexible schedule and eliminating commute time, yet it might strain company culture as
spontaneous interactions diminish and building a cohesive team becomes more challenging. Strategies
like regular video meetings and digital team-building exercises can help mitigate these cultural
challenges."
Prompt Request Coverage: This response comprehensively covers the prompt by discussing both the
positive and negative impacts of remote work on productivity and company culture.
Constraints: It adheres to the prompt's constraints by providing an analysis within the scope of remote
work's impact on the specified areas.
Breadth of Solutions [STEM]: The response provides a breadth of solutions to address the potential
negative impacts, indicating a high level of completeness by considering various strategies to mitigate
the downsides of remote work on company culture.
Your preview ends here
Eager to read complete document? Join bartleby learn and gain access to the full version
- Access to all documents
- Unlimited textbook solutions
- 24/7 expert homework help