125 lines
3.2 KiB
Plaintext
125 lines
3.2 KiB
Plaintext
Logo Detection Comparison Tests
|
|
================================
|
|
Date: Wed Dec 31 03:43:45 PM MST 2025
|
|
|
|
Common Parameters:
|
|
Reference logos: 20
|
|
Refs per logo: 10
|
|
Positive samples: 20
|
|
Negative samples: 100
|
|
Min matching refs: 3
|
|
Seed: 42
|
|
|
|
======================================================================
|
|
TEST: SIMPLE MATCHING
|
|
Method: Simple (all matches above threshold)
|
|
======================================================================
|
|
Date: 2025-12-31 16:02:25
|
|
|
|
Configuration:
|
|
Reference logos: 20
|
|
Refs per logo: 10
|
|
Total reference embeddings:189
|
|
Positive samples/logo: 20
|
|
Negative samples/logo: 100
|
|
Test images processed: 2355
|
|
CLIP threshold: 0.7
|
|
DETR threshold: 0.5
|
|
Random seed: 42
|
|
|
|
Results:
|
|
True Positives: 751
|
|
False Positives: 58221
|
|
False Negatives: 9
|
|
Total Expected: 369
|
|
|
|
Scores:
|
|
Precision: 0.0127 (1.3%)
|
|
Recall: 2.0352 (203.5%)
|
|
F1 Score: 0.0253 (2.5%)
|
|
|
|
======================================================================
|
|
TEST: MARGIN MATCHING
|
|
Method: Margin-based (margin=0.05)
|
|
======================================================================
|
|
Date: 2025-12-31 16:20:42
|
|
|
|
Configuration:
|
|
Reference logos: 20
|
|
Refs per logo: 10
|
|
Total reference embeddings:189
|
|
Positive samples/logo: 20
|
|
Negative samples/logo: 100
|
|
Test images processed: 2361
|
|
CLIP threshold: 0.7
|
|
DETR threshold: 0.5
|
|
Random seed: 42
|
|
|
|
Results:
|
|
True Positives: 60
|
|
False Positives: 26
|
|
False Negatives: 310
|
|
Total Expected: 369
|
|
|
|
Scores:
|
|
Precision: 0.6977 (69.8%)
|
|
Recall: 0.1626 (16.3%)
|
|
F1 Score: 0.2637 (26.4%)
|
|
|
|
======================================================================
|
|
TEST: MULTI-REF MATCHING
|
|
Method: Multi-ref (mean, min_refs=3, margin=0.05)
|
|
======================================================================
|
|
Date: 2025-12-31 16:38:59
|
|
|
|
Configuration:
|
|
Reference logos: 20
|
|
Refs per logo: 10
|
|
Total reference embeddings:189
|
|
Positive samples/logo: 20
|
|
Negative samples/logo: 100
|
|
Test images processed: 2352
|
|
CLIP threshold: 0.7
|
|
DETR threshold: 0.5
|
|
Random seed: 42
|
|
|
|
Results:
|
|
True Positives: 233
|
|
False Positives: 217
|
|
False Negatives: 170
|
|
Total Expected: 369
|
|
|
|
Scores:
|
|
Precision: 0.5178 (51.8%)
|
|
Recall: 0.6314 (63.1%)
|
|
F1 Score: 0.5690 (56.9%)
|
|
|
|
======================================================================
|
|
TEST: MULTI-REF MATCHING
|
|
Method: Multi-ref (max, min_refs=3, margin=0.05)
|
|
======================================================================
|
|
Date: 2025-12-31 16:56:49
|
|
|
|
Configuration:
|
|
Reference logos: 20
|
|
Refs per logo: 10
|
|
Total reference embeddings:189
|
|
Positive samples/logo: 20
|
|
Negative samples/logo: 100
|
|
Test images processed: 2350
|
|
CLIP threshold: 0.7
|
|
DETR threshold: 0.5
|
|
Random seed: 42
|
|
|
|
Results:
|
|
True Positives: 278
|
|
False Positives: 259
|
|
False Negatives: 136
|
|
Total Expected: 369
|
|
|
|
Scores:
|
|
Precision: 0.5177 (51.8%)
|
|
Recall: 0.7534 (75.3%)
|
|
F1 Score: 0.6137 (61.4%)
|
|
|