Evidence ledger / 02 / Scouting criteria
UNDERSTAND THE SCOUTING LENS
Evaluation becomes fairer and more useful when the role is defined before the player is judged.
Begin with the team’s actual problem
A team does not recruit a statistic in isolation. It recruits someone to perform particular tasks alongside other people, within a schedule and a competitive environment. Staff should first describe the vacancy: the responsibilities, communication demands, expected preparation and realistic development support. Without that description, comparisons can drift towards whoever produced the most memorable recent performance.
Players can ask for the same clarity. Is the organisation seeking an established starter, a flexible substitute or someone for a development roster? Does the role require immediate tactical leadership? Are there language, location or eligibility requirements? An answer need not reveal confidential strategy, but it should give a candidate enough context to decide whether further assessment makes sense.
Compare like with like where possible
Ranked play, organised practice and tournament competition are different environments. A ranked result can demonstrate execution under certain conditions without establishing how someone follows a shared game plan. A scrim can expose coordination but may involve experimental tactics. Official matches add stakes and defined rules, yet a small sample can still mislead. Label the environment before interpreting the result.
Game-specific roles matter too. A Dota 2 support and a core player do not receive the same resources. Rocket League evaluation may examine spacing and recovery alongside mechanical execution. In Counter-Strike 2, a player’s assigned positions shape the duels they are likely to take. Cross-game labels such as “aggressive” are too broad unless they are tied to concrete responsibilities and examples.
| Area | Useful evidence | Interpretation limit |
|---|---|---|
| Role execution | Several complete games in the intended role | Different opponents create different demands |
| Decision quality | Timestamped choices and available information | A good decision can still lose |
| Communication | Consented team audio and observed calls | Unfamiliar teammates can change the sample |
| Adaptation | A repeated task after specific feedback | One improvement does not establish a habit |
| Reliability | Agreed attendance and preparation records | Context matters; avoid intrusive monitoring |
Write the observation first. Add the interpretation second. Keep the uncertainty visible.
Separate outcome from decision quality
A successful play can contain a poor decision that an opponent failed to punish. A failed play can be a reasonable response to incomplete information. Reviewers should reconstruct what the player knew at the time, what alternatives were available and how the choice supported the team plan. Hindsight is useful for learning, but it can distort evaluation if it becomes the only standard.
Ask players to explain selected moments without turning the conversation into a defence of every mistake. A useful explanation acknowledges uncertainty and recognises an alternative. Staff should also identify positive decisions that did not produce an immediate reward. This makes the assessment more specific than simply attaching praise to wins and criticism to losses.
Make feedback observable
“Needs better communication” is too vague to test. “Call the intended rotation before leaving the position” creates an observable task. Agree one or two changes, provide a reasonable opportunity to try them and compare subsequent examples. This can reveal whether the feedback was understood, whether the task was realistic and whether the team’s own instructions were clear.
Use more than one reviewer where resources permit. Have reviewers record initial notes independently before discussing them, so the first confident opinion does not automatically set the group’s view. Record conflicting interpretations rather than forcing artificial agreement. A rubric should guide attention, not pretend that a human decision has become objective merely because it includes scores.
Keep integrity and dignity in the process
Competitive integrity is relevant, but suspicion is not proof. Verify claims through appropriate official records and allow a person to correct mistaken identity or explain an apparent discrepancy. Consult the applicable event rules rather than relying on rumours or a third-party badge. The Esports Integrity Commission publishes integrity resources, while individual publishers and organisers retain their own rules and enforcement processes.
A final decision should state what was observed, how it relates to the vacancy and what remains unknown. Declining a player does not require a global verdict on their future. For players, that distinction matters: a mismatch with one roster can coexist with a credible record and a productive next step elsewhere.