Response time is useful only when paired with quality and context. A sound SAR evaluation examines command, search planning, information management, resource use, communications, safety, coordination, handoffs and the team's ability to adapt. Measures should be defined before the exercise and interpreted against the information and resources actually available.
The purpose is to explain performance well enough to improve it—not to create a league table from unlike missions.
Build measures from objectives
If the objective is to establish command, observe how authority, roles and priorities were communicated. If the objective is search planning, examine how information became search areas and assignments. If it is multi-agency coordination, measure the exchanges and shared decisions between organizations.
Every measure needs a definition, evidence source and evaluator. Time to first assignment, for example, should specify when the clock starts, what counts as an assignment and which delays are inside the team's control.
Evaluate command and decision-making
Look for a clear command structure appropriate to the mission, stated objectives, delegated responsibilities, a decision record and adjustment when conditions change. Assess whether the organization grew or simplified in response to complexity.
Ask why major decisions were made. The result alone can mislead: a subject may be found despite a weak plan, or a well-managed search may not find a subject within the exercise period.
Evaluate search planning and information
Examine how the team developed its search area, priorities and tactics from clues, last-known information, terrain, weather and operational constraints. Check whether assumptions were visible and updated.
Useful evidence includes map versions, clue logs, probability or priority rationale where locally used, searched-area status and unresolved information requirements. The evaluation should be appropriate to the SAR discipline and local doctrine.
Evaluate resources and logistics
Record whether requests identified the capability needed, whether assigned resources were suitable, and whether their status was maintained. Include briefing, staging, support, relief and demobilization.
Do not count the number of resources as a proxy for effectiveness. A large response can create congestion or exceed support capacity. Evaluate the relationship between mission need and assignment.
Evaluate communications and coordination
Check whether critical messages were accurate, acknowledged and shared with the roles that needed them. Observe what happened when a communication path failed or an agency used different terminology.
For multi-agency operations, assess shared objectives, liaison, request pathways and the common operating picture. Identify which issues came from policy or interoperability rather than individual technique.
Evaluate safety as an operating process
Safety evaluation is more than noting whether an injury occurred. Observe hazard identification, briefings, accountability, changing conditions, stop or withdrawal decisions and communication of controls. A scenario that produces no incident can still reveal unsafe assumptions.
Live technical skills should be evaluated only by qualified personnel using the relevant standards. A command simulation can assess recognition and coordination of a technical requirement, not certify hands-on proficiency.
Use a balanced evidence set
Dimension | Example question |
|---|---|
Timeliness | Was the action taken when it could still influence the mission? |
Quality | Was the decision supported by current and credible information? |
Completeness | Were critical tasks and records maintained? |
Coordination | Did organizations understand priorities and dependencies? |
Adaptation | Did the plan change when evidence changed? |
Safety | Were hazards and controls actively managed? |
Sustainability | Were relief, support and the next period considered? |
Use narrative findings alongside quantitative data. A timestamp can reveal delay; observation and participant explanation reveal the cause.
Control for exercise artifacts
Validate whether an inject arrived as planned, whether simulated resources behaved consistently and whether tools were available as promised. If a failure was caused by exercise control, record it separately. Do not turn a design flaw into an operational finding.
Convert findings into retestable actions
Write specific findings that identify the observed condition, effect and contributing factors. Assign actions to an owner with an expected result and review date. Choose a suitable retest: a short map simulation for search planning, a communications drill for fallback procedures or a functional event for a command handoff.
The strongest evaluation tells a coherent story from objective to evidence to improvement. Time remains part of that story, but never the whole of it.
Sources
FEMA Exercise Evaluation Guides: https://preptoolkit.fema.gov/web/hseep-resources/eegs
FEMA Improvement Planning Resources: https://preptoolkit.fema.gov/web/hseep-resources/improvement-planning
FEMA Homeland Security Exercise and Evaluation Program: https://training.fema.gov/programs/nsec/hseep/
FEMA National Search and Rescue Response System: https://www.fema.gov/emergency-managers/national-preparedness/frameworks/search-rescue
National Search and Rescue Committee resources: https://www.dco.uscg.mil/Our-Organization/Assistant-Commandant-for-Response-Policy-CG-5R/Office-of-Incident-Management-Preparedness-CG-5RI/US-Coast-Guard-Office-of-Search-and-Rescue-CG-SAR/NSARC/
Continue the conversation
Every training environment has different constraints. If you are working through how to make scenarios more repeatable, measurable, or accessible, share your training challenge with us.
Response time is useful only when paired with quality and context. A sound SAR evaluation examines command, search planning, information management, resource use, communications, safety, coordination, handoffs and the team's ability to adapt. Measures should be defined before the exercise and interpreted against the information and resources actually available.
The purpose is to explain performance well enough to improve it—not to create a league table from unlike missions.
Build measures from objectives
If the objective is to establish command, observe how authority, roles and priorities were communicated. If the objective is search planning, examine how information became search areas and assignments. If it is multi-agency coordination, measure the exchanges and shared decisions between organizations.
Every measure needs a definition, evidence source and evaluator. Time to first assignment, for example, should specify when the clock starts, what counts as an assignment and which delays are inside the team's control.
Evaluate command and decision-making
Look for a clear command structure appropriate to the mission, stated objectives, delegated responsibilities, a decision record and adjustment when conditions change. Assess whether the organization grew or simplified in response to complexity.
Ask why major decisions were made. The result alone can mislead: a subject may be found despite a weak plan, or a well-managed search may not find a subject within the exercise period.
Evaluate search planning and information
Examine how the team developed its search area, priorities and tactics from clues, last-known information, terrain, weather and operational constraints. Check whether assumptions were visible and updated.
Useful evidence includes map versions, clue logs, probability or priority rationale where locally used, searched-area status and unresolved information requirements. The evaluation should be appropriate to the SAR discipline and local doctrine.
Evaluate resources and logistics
Record whether requests identified the capability needed, whether assigned resources were suitable, and whether their status was maintained. Include briefing, staging, support, relief and demobilization.
Do not count the number of resources as a proxy for effectiveness. A large response can create congestion or exceed support capacity. Evaluate the relationship between mission need and assignment.
Evaluate communications and coordination
Check whether critical messages were accurate, acknowledged and shared with the roles that needed them. Observe what happened when a communication path failed or an agency used different terminology.
For multi-agency operations, assess shared objectives, liaison, request pathways and the common operating picture. Identify which issues came from policy or interoperability rather than individual technique.
Evaluate safety as an operating process
Safety evaluation is more than noting whether an injury occurred. Observe hazard identification, briefings, accountability, changing conditions, stop or withdrawal decisions and communication of controls. A scenario that produces no incident can still reveal unsafe assumptions.
Live technical skills should be evaluated only by qualified personnel using the relevant standards. A command simulation can assess recognition and coordination of a technical requirement, not certify hands-on proficiency.
Use a balanced evidence set
Dimension | Example question |
|---|---|
Timeliness | Was the action taken when it could still influence the mission? |
Quality | Was the decision supported by current and credible information? |
Completeness | Were critical tasks and records maintained? |
Coordination | Did organizations understand priorities and dependencies? |
Adaptation | Did the plan change when evidence changed? |
Safety | Were hazards and controls actively managed? |
Sustainability | Were relief, support and the next period considered? |
Use narrative findings alongside quantitative data. A timestamp can reveal delay; observation and participant explanation reveal the cause.
Control for exercise artifacts
Validate whether an inject arrived as planned, whether simulated resources behaved consistently and whether tools were available as promised. If a failure was caused by exercise control, record it separately. Do not turn a design flaw into an operational finding.
Convert findings into retestable actions
Write specific findings that identify the observed condition, effect and contributing factors. Assign actions to an owner with an expected result and review date. Choose a suitable retest: a short map simulation for search planning, a communications drill for fallback procedures or a functional event for a command handoff.
The strongest evaluation tells a coherent story from objective to evidence to improvement. Time remains part of that story, but never the whole of it.
Sources
FEMA Exercise Evaluation Guides: https://preptoolkit.fema.gov/web/hseep-resources/eegs
FEMA Improvement Planning Resources: https://preptoolkit.fema.gov/web/hseep-resources/improvement-planning
FEMA Homeland Security Exercise and Evaluation Program: https://training.fema.gov/programs/nsec/hseep/
FEMA National Search and Rescue Response System: https://www.fema.gov/emergency-managers/national-preparedness/frameworks/search-rescue
National Search and Rescue Committee resources: https://www.dco.uscg.mil/Our-Organization/Assistant-Commandant-for-Response-Policy-CG-5R/Office-of-Incident-Management-Preparedness-CG-5RI/US-Coast-Guard-Office-of-Search-and-Rescue-CG-SAR/NSARC/
Continue the conversation
Every training environment has different constraints. If you are working through how to make scenarios more repeatable, measurable, or accessible, share your training challenge with us.