Problem

In the last RnDAO Collabberry epoch, issues arose due to differing interpretations of whether someone had worked with a peer or not. Some team members felt it was unfair to be assessed by individuals who don’t work directly with them and, therefore, may not have the full picture of their contributions.

Context is not a binary concept where one either has it or does not; people have varying levels of context with their teammates. This variability can lead to feelings of unfairness, particularly when someone with very little context gives scores that negatively impact a peer's overall evaluation, despite not fully understanding the peer's work.

Solution

Introduce a self-stated level of context that each contributor declares about the peer they are assessing. This context weight will influence the final compensation formula, ensuring that evaluations are more reflective of actual understanding and familiarity with the peer's contributions.

Implementation

UI

The P2P assessment form now will include one more input for each contributor - Context Range.

Algorithm

1. Context Weight: Each contributor will assign a context weight (from 1 to 5) when evaluating their peers. This weight represents how well the contributor knows the work of the peer they are reviewing.
   • Weight 1: Very little context
   • Weight 2: Some context
   • Weight 3: Moderate context
   • Weight 4: Good context
   • Weight 5: Excellent context

Step 1: Calculate Weighted Average Score

Instead of using a simple average of the scores received by each contributor, calculate a Weighted Average Score that accounts for the context weight. This can be done by multiplying each performance score by its corresponding context weight and then dividing by the sum of the context weights.

$$ \text{WAS} = \frac{\sum (S_i \times W_i)}{\sum W_i} $$

Where:

• WAS - Weighted Average Score
• S_i - is the score given by contributor i
• W_i is the context weight assigned by contributor i

Step 2: Calculate the Salary Adjustment Multiplier

The Salary Adjustment Multiplier (SAM) will now be calculated using the Weighted Average Score:

$$ SAM = (WAS - 3)* PAR $$