Spaces:
Sleeping
Sleeping
| Summary Statistics: | |
| Milvus + LLaMA: | |
| RMSE_Context_Rel RMSE_Context_Util AUCROC Retrieval_Time Context_Relevance Context_Utilization | |
| count 19.0000 19.0000 17.0000 19.0000 19.0000 19.0000 | |
| mean 0.1786 0.3022 0.9118 0.1322 0.6402 0.6729 | |
| std 0.2014 0.3444 0.1965 0.0288 0.2923 0.2889 | |
| min 0.0000 0.0008 0.5000 0.1008 0.0000 0.0000 | |
| 25% 0.0211 0.0559 1.0000 0.1145 0.4083 0.4583 | |
| 50% 0.1160 0.1033 1.0000 0.1233 0.6667 0.6667 | |
| 75% 0.2826 0.5837 1.0000 0.1348 0.9500 1.0000 | |
| max 0.5625 0.9654 1.0000 0.1954 1.0000 1.0000 | |
| Weaviate + Mistral: | |
| Retrieval_Time Context_Rel Util Adherence RMSE_Context_Rel RMSE_Context_Util AUCROC | |
| count 19.0000 18.0000 18.0000 18.0000 16.0000 16.0000 14.0000 | |
| mean 0.1565 0.5913 0.6190 0.3889 0.4139 0.4824 0.7500 | |
| std 0.0286 0.4559 0.4324 0.5016 0.3231 0.3404 0.2594 | |
| min 0.1085 0.0000 0.0000 0.0000 0.0035 0.0035 0.5000 | |
| 25% 0.1254 0.0357 0.1905 0.0000 0.1426 0.1702 0.5000 | |
| 50% 0.1685 0.8333 0.8333 0.0000 0.3212 0.5028 0.7500 | |
| 75% 0.1720 1.0000 1.0000 1.0000 0.7199 0.8521 1.0000 | |
| max 0.2132 1.0000 1.0000 1.0000 0.9481 0.9481 1.0000 | |
| Milvus + Mistral: | |
| Retrieval_Time Context_Rel Util Adherence RMSE_Context_Rel RMSE_Context_Util AUCROC | |
| count 0.0 19.0000 19.0000 18.0000 18.0000 18.0000 16.0000 | |
| mean NaN 0.5176 0.6144 0.7847 0.1665 0.2575 0.8438 | |
| std NaN 0.3481 0.3511 0.3878 0.1819 0.2662 0.2394 | |
| min NaN 0.0000 0.0000 0.0000 0.0017 0.0031 0.5000 | |
| 25% NaN 0.2917 0.3542 0.7188 0.0408 0.0625 0.5000 | |
| 50% NaN 0.5000 0.6111 1.0000 0.0808 0.1627 1.0000 | |
| 75% NaN 0.8397 1.0000 1.0000 0.2500 0.3448 1.0000 | |
| max NaN 1.0000 1.0000 1.0000 0.6049 0.8711 1.0000 |