Body: <p>I have got multi-class object detector. One model accuracy evaluation of detection consists of: <strong>mAP, FP, FN, TP</strong> for each class divided to two graphs and looks like this (I've used <a href="https://github.com/rafaelpadilla/Object-Detection-Metrics" rel="nofollow noreferrer">this repo</a> for evaluation).</p>
  
  <p><a href="https://i.sstatic.net/rBRlb.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/rBRlb.png" alt="enter image description here"></a></p>
  
  <p>Now, I've got many of these evaluations (multiple times these two graphs for different models) and I would like to easily compare all these trained models (results) and put them to <strong>one</strong> graph.</p>
  
  <p>I've searched through the whole Internet, but wasn't able to find suitable method of placing all the values to one graph. Also, the values of these three classes can be put together (eg. result mAP for this evaluation would be (75+ 68+ 66) / 3 = ~70%), so I would have just single value of each mAP, FN, FP, TP for one whole model evaluation.</p>
  
  <p>What comes to my mind is the following graph (or maybe some kind of plot):</p>
  
  <p><a href="https://i.sstatic.net/mYQLs.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/mYQLs.png" alt="enter image description here"></a></p>
  
  <p><strong>Note:</strong> It may not make sense to place mAP together with TP, etc. into one graph, but I would like to have all these values together to easily compare all the model evaluations. Also I am not really looking for a script, I can do the graph manually from values, but script would be more helpful. What really matters is, how to create meaningful graph with all the data :). If the post is more suitable for different kind of site, please, let me know.</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2019-02-04T18:34:01.907Z
Comments.Text: @DuttaA Thanks, I wasn't sure about that one.
Comments.UserDisplayName: kocica
Tags: <neural-networks><graphs>
Title: How to create meaningful multiple object detection evaluation comparison graph?
UserDisplayName: kocica
ThreadText: # How to create meaningful multiple object detection evaluation comparison graph?
  
  (Asked by: username_0 on 2019-02-04)
  
  I have got multi-class object detector. One model accuracy evaluation of detection consists of: **mAP, FP, FN, TP** for each class divided to two graphs and looks like this (I've used [this repo](https://github.com/rafaelpadilla/Object-Detection-Metrics) for evaluation).
  
  [![enter image description here](https://i.sstatic.net/rBRlb.png)](https://i.sstatic.net/rBRlb.png)
  
  Now, I've got many of these evaluations (multiple times these two graphs for different models) and I would like to easily compare all these trained models (results) and put them to **one** graph.
  
  I've searched through the whole Internet, but wasn't able to find suitable method of placing all the values to one graph. Also, the values of these three classes can be put together (eg. result mAP for this evaluation would be (75+ 68+ 66) / 3 = ~70%), so I would have just single value of each mAP, FN, FP, TP for one whole model evaluation.
  
  What comes to my mind is the following graph (or maybe some kind of plot):
  
  [![enter image description here](https://i.sstatic.net/mYQLs.png)](https://i.sstatic.net/mYQLs.png)
  
  **Note:** It may not make sense to place mAP together with TP, etc. into one graph, but I would like to have all these values together to easily compare all the model evaluations. Also I am not really looking for a script, I can do the graph manually from values, but script would be more helpful. What really matters is, how to create meaningful graph with all the data :). If the post is more suitable for different kind of site, please, let me know.
  
  **Tags:** neural-networks, graphs
  > **Comments:**
  > **username_0**: @DuttaA Thanks, I wasn't sure about that one.  
  
  ---
  
  ## 0 answers
  
  