Answers.Body: <p>As with all PAMGuard problems, it is helpful if you can include the version number and also copy any error messages from the black command window, which sits behind the main display window. If this text is no longer visible (e.g. due to a catastrophic crash) then you'll find the same text in a set of log files in a folder burried in your user folders, e.g. something like C:/users/***/Pamguard. There is a link to this folder in the PAMGuard Help menu. Errors from that window which seem to be genuine bugs should also be sent to support@pamguard.org</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2024-11-13T14:03:02.220Z
Answers.LastActivityDate: 2024-11-13T14:03:02.220Z
Answers.UserDisplayName: Doug Gillespie
Answers.Body: <p>I wanted to post my comment as an answer for future users, as this is a Soundtrap data offload issue and not an issue with PAMGuard.</p>
  <p>If you have downloaded 1kb SUD files, there may be connection issues between the Soundtrap and computer, leading to offload errors. Depending on the Soundtrap Host software version you are using these errors may or may not be noticeable.</p>
  <p>If you look at the 'File Listing' window in the soundtrap host software you can see the 'Saved' column. If it says 'Partial' there may have been an offload error. From this window you can also see the size of the files. Check to make sure none of those sizes are 1kb. If they all look good on the host software try redownloading those files.</p>
  <p>If the issue is not resolved, and you see file sizes that are drastically smaller than others, there may have been a gap in sampling.</p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2024-08-13T13:48:47.317Z
Answers.Text: Thanks for updating your comment to a question - that is very helpful!
Answers.UserDisplayName: selene
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2024-08-12T21:03:10.000Z
Answers.LastActivityDate: 2024-08-12T21:03:10.000Z
Answers.UserDisplayName: Kourtney Burger
Body: <p>UPDATE: The issue related to this question was due to some 1KB files incorrectly downloaded from the soundtrap, that were not allowing PAMguard to process the next files after those.</p>
  <hr />
  <p>PAMguard (version 2.2.09) on Windows 11  is leaving quite a lot of files unproccesed. They are all in the same folder, but apparently it cannot access to some of them (image 1), and it appears to be in a random manner (image 2). We have been proccessing them directly as .sud  since the last PAMguard version.</p>
  <p>We tried unzipping the problematic files into .wav and opened it in Audacity, and they can be heard with no problem. We also re-run the folder in PAMGuard in smaller datasets (2 weeks); and lastly, we tried proccesing them as .vaw, and re-run only 2 days worth of data, but also it did not work. So far, we have only been able to proccess them if we select one by one (which is not very comfortable for the long-term)</p>
  <p>In case anybody is familiar with this situation, or has any idea how to get PAMguard to access the  files would really appreciate! Thank you!</p>
  <p><a href="https://i.sstatic.net/ZnTsL.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/ZnTsL.png" alt="enter image description here" /></a></p>
  <p><a href="https://i.sstatic.net/RCvlf.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/RCvlf.png" alt="enter image description here" /></a></p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2024-01-23T19:58:39.543Z
Comments.Text: What happens if you reduce the number of files such that only 1 or 2  of the socalled 'corrupt' files are present (given by the hole in the longer sequence)? Is alway the same file not readable or does it vary?
Comments.UserDisplayName: WMXZ
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2024-01-25T10:51:40.057Z
Comments.Text: It appears to be the same files always. We have realised there are several recordings of only 1KB from this deployment, and it cannot read those ones (of course), but also does not read the following 'normal' recording right after those. If i select only these ones -without the 1kb files- it can proccess them without any problem.
Comments.UserDisplayName: Angaro
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2024-01-25T18:12:29.913Z
Comments.Text: OK, it seems to be the files them self as you suggested in OP. Can you decode the files with Soundtrap-Host program, or with the soundtrap reader? Your OP is not clear in that sense (AFAIK, there is no zip format involved)
Comments.UserDisplayName: WMXZ
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2024-01-26T19:35:59.583Z
Comments.Text: Would it be workable to sort your files by size, pull all those 1 kb 'bad' files into a 'bad files' folder, and then only process the 'normal' files all in one go? Or does it still get stuck on the offending files even without the 1 kb bad file before it?
Comments.UserDisplayName: selene
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2024-01-29T09:27:08.727Z
Comments.Text: Thanks to both of you for your comments. And my apologies, i am quite new to this and I am not sure what OP means (Original Poster?). Anyhow, I did as Selene suggested and it worked! I could extract with Soundtrap-Host (except for the 1KB files). But I also proccessed them in .sud format and it was good :) It seemed that the 1KB files were  preventeding PAMguard in some way from continuing processing the next files after those. Next step will be figuring out why the soundtrap recorded so many 1kb files (...but that's a story for another day). Thank you!
Comments.UserDisplayName: Angaro
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2024-01-29T15:47:55.033Z
Comments.Text: mabe you could post one 1kb sud file, so one can look into it with hexeditor?
Comments.UserDisplayName: WMXZ
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2024-01-31T09:46:27.147Z
Comments.Text: I believe Stack Exchange does not allow to upload files, but maybe this works: https://we.tl/t-gVzeuqZ8vW
Comments.UserDisplayName: Angaro
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2024-01-31T17:51:12.593Z
Comments.Text: One possible reason you are getting so many 1kb files is that there may have been offloading errors. What model soundtrap are you using? Do you still have the data on the recorder? I have had several occasions where some files randomly failed to offload. If you look at the 'File Listing' window in the soundtrap host software you can  see the size of the files. Check to make sure none of those sizes are 1kb. If they all look good on the host software try redownloading those files.
Comments.UserDisplayName: Kourtney Burger
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2024-02-07T18:13:16.660Z
Comments.Text: So it was exactly that Kourtney. We are using ST300HF. We have re-downloaded the 1kb files manually (from Soundtrap Host 3.5.0.27712) and it is all good. Thank you very much!
Comments.UserDisplayName: Angaro
Tags: <pamguard><recording><files>
Title: PAMGuard not reading files - SoundTrap data offload issues
ThreadText: # PAMGuard not reading files - SoundTrap data offload issues
  
  (Asked by: username_0 on 2024-01-23)
  
  UPDATE: The issue related to this question was due to some 1KB files incorrectly downloaded from the soundtrap, that were not allowing PAMguard to process the next files after those.
  
  ---
  
  PAMguard (version 2.2.09) on Windows 11 is leaving quite a lot of files unproccesed. They are all in the same folder, but apparently it cannot access to some of them (image 1), and it appears to be in a random manner (image 2). We have been proccessing them directly as .sud since the last PAMguard version.
  
  We tried unzipping the problematic files into .wav and opened it in Audacity, and they can be heard with no problem. We also re-run the folder in PAMGuard in smaller datasets (2 weeks); and lastly, we tried proccesing them as .vaw, and re-run only 2 days worth of data, but also it did not work. So far, we have only been able to proccess them if we select one by one (which is not very comfortable for the long-term)
  
  In case anybody is familiar with this situation, or has any idea how to get PAMguard to access the files would really appreciate! Thank you!
  
  [![enter image description here](https://i.sstatic.net/ZnTsL.png)](https://i.sstatic.net/ZnTsL.png)
  
  [![enter image description here](https://i.sstatic.net/RCvlf.png)](https://i.sstatic.net/RCvlf.png)
  
  **Tags:** pamguard, recording, files
  
  > **Comments:**
  > **username_1**: What happens if you reduce the number of files such that only 1 or 2  of the socalled 'corrupt' files are present (given by the hole in the longer sequence)? Is alway the same file not readable or does it vary?  
  > **username_0**: It appears to be the same files always. We have realised there are several recordings of only 1KB from this deployment, and it cannot read those ones (of course), but also does not read the following 'normal' recording right after those. If i select only these ones -without the 1kb files- it can proccess them without any problem.  
  > **username_1**: OK, it seems to be the files them self as you suggested in OP. Can you decode the files with Soundtrap-Host program, or with the soundtrap reader? Your OP is not clear in that sense (AFAIK, there is no zip format involved)  
  > **username_2**: Would it be workable to sort your files by size, pull all those 1 kb 'bad' files into a 'bad files' folder, and then only process the 'normal' files all in one go? Or does it still get stuck on the offending files even without the 1 kb bad file before it?  
  > **username_0**: Thanks to both of you for your comments. And my apologies, i am quite new to this and I am not sure what OP means (Original Poster?). Anyhow, I did as Selene suggested and it worked! I could extract with Soundtrap-Host (except for the 1KB files). But I also proccessed them in .sud format and it was good :) It seemed that the 1KB files were  preventeding PAMguard in some way from continuing processing the next files after those. Next step will be figuring out why the soundtrap recorded so many 1kb files (...but that's a story for another day). Thank you!  
  > **username_1**: mabe you could post one 1kb sud file, so one can look into it with hexeditor?  
  > **username_0**: I believe Stack Exchange does not allow to upload files, but maybe this works: https://we.tl/t-gVzeuqZ8vW  
  > **username_3**: One possible reason you are getting so many 1kb files is that there may have been offloading errors. What model soundtrap are you using? Do you still have the data on the recorder? I have had several occasions where some files randomly failed to offload. If you look at the 'File Listing' window in the soundtrap host software you can  see the size of the files. Check to make sure none of those sizes are 1kb. If they all look good on the host software try redownloading those files.  
  > **username_0**: So it was exactly that Kourtney. We are using ST300HF. We have re-downloaded the 1kb files manually (from Soundtrap Host 3.5.0.27712) and it is all good. Thank you very much!  
  
  ---
  
  ## 2 answers
  
  ### Answer by username_3 on 2024-08-12. Score: 6 | Accepted answer
  
  I wanted to post my comment as an answer for future users, as this is a Soundtrap data offload issue and not an issue with PAMGuard.
  
  If you have downloaded 1kb SUD files, there may be connection issues between the Soundtrap and computer, leading to offload errors. Depending on the Soundtrap Host software version you are using these errors may or may not be noticeable.
  
  If you look at the 'File Listing' window in the soundtrap host software you can see the 'Saved' column. If it says 'Partial' there may have been an offload error. From this window you can also see the size of the files. Check to make sure none of those sizes are 1kb. If they all look good on the host software try redownloading those files.
  
  If the issue is not resolved, and you see file sizes that are drastically smaller than others, there may have been a gap in sampling.
  
  > **Comments:**
  > **username_2**: Thanks for updating your comment to a question - that is very helpful!  
  
  ---
  
  ### Answer by username_4 on 2024-11-13. Score: 4
  
  As with all PAMGuard problems, it is helpful if you can include the version number and also copy any error messages from the black command window, which sits behind the main display window. If this text is no longer visible (e.g. due to a catastrophic crash) then you'll find the same text in a set of log files in a folder burried in your user folders, e.g. something like C:/users/\*\*\*/Pamguard. There is a link to this folder in the PAMGuard Help menu. Errors from that window which seem to be genuine bugs should also be sent to support@pamguard.org
  
  
  ---
  
  