Skip to contents

Calculate Strategy Comparison Metrics

Usage

calc_strategy_comparison(strategy1_results, strategy2_results, gold_standard)

Arguments

strategy1_results

Vector of article IDs from strategy 1

strategy2_results

Vector of article IDs from strategy 2

gold_standard

Vector of relevant article IDs

Value

List containing comparison metrics

Details

Compares two search strategies across multiple dimensions:

  • overlap_analysis: Articles found by both, one, or neither strategy

  • performance_comparison: Precision, recall, F1 for each strategy

  • complementarity: How well strategies complement each other

  • efficiency_comparison: Relative efficiency metrics

Examples

strategy1 <- c("art1", "art2", "art3", "art4", "art5")
strategy2 <- c("art3", "art4", "art5", "art6", "art7")
gold_standard <- c("art1", "art3", "art5", "art8", "art9")

comparison <- calc_strategy_comparison(strategy1, strategy2, gold_standard)
print(comparison$overlap_analysis)
#> $overlap_count
#> [1] 3
#> 
#> $unique_to_strategy1
#> [1] 2
#> 
#> $unique_to_strategy2
#> [1] 2
#> 
#> $total_unique
#> [1] 7
#> 
#> $overlap_percentage
#> [1] 42.85714
#>