Answers.Body: <p>It sounds like it to me too. I have never directly accessed NCBIs stuff via Google buckets and I don't know what permissions they are setting for direct access.</p>
  <p>So ... I briefly checked it out</p>
  <pre><code>gsutil ls gs://sra-pub-crun-4
  </code></pre>
  <p>and 'yes' its possible but ...</p>
  <blockquote>
  <p>BadRequestException: 400 Bucket is a requester pays bucket but no user project provided.</p>
  </blockquote>
  <p>'Requester pay' luckily I wasn't logged in :-)</p>
  <p>What the message implies given access to your (my) GCP account and they'll bill you (me). I don't think it will be much, particularly for a 'list' request, however I ain't gonna find out for a data set I don't need. I do doubt I'm going to get billed for 'list' request, however I've never paid 'list' request I prefer to keep it that way. In contrast, NCBI's front-end is free and thats what they want, because they could of course set the bucket so they pay.</p>
  <p>So in answer the question, if you wanna pay go ahead ... dial up a GCP account link it to pay.</p>
  <hr />
  <p>Here's my first answer</p>
  <p>Please note I'm not really certain what information the OP seeks here, e.g. gs:// locations type stuff. <em>If the question is where's the SRS database on every gs:// path ...</em> I don't know.</p>
  <p>I think the OP wants an API ... Google Cloud certainly use APIs by the bucket load (no pun intended but I thought it was funny). I don't use them because they are excessively verbose and I prefer SDK and gcloud tools, of which <code>gsutil</code> is one.</p>
  <blockquote>
  <p>It also sounds like fastq-dump and fasterq-dump can be configured with Google Cloud credentials to download that for me.</p>
  </blockquote>
  <p>If I have understood correctly and that is all you want then sure</p>
  <pre><code>gsutil cp gs://sra-pub-crun-4/SRR1929796/SRR1929796.1 .
  </code></pre>
  <p>will do it, if permitted (or in hindsight prepared to pay) and there will be an API version of this.</p>
  <hr />
  <p><strong>Background</strong></p>
  <p>Installation via Google's <code>Cloud SDK</code>, via  <a href="https://cloud.google.com/storage/docs/gsutil_install#install" rel="nofollow noreferrer">https://cloud.google.com/storage/docs/gsutil_install#install</a></p>
  
Answers.ContentLicense: CC BY-SA 4.0
Answers.CreationDate: 2022-03-29T19:00:39.037Z
Answers.LastActivityDate: 2022-03-29T22:37:05.290Z
Answers.LastEditDate: 2022-03-29T22:37:05.290Z
Answers.UserDisplayName: M__
Body: <p>It appears that AWS and GCP host SRA data and it's beneficial to grab the data from that source when running on GCP for example.</p>
  <p>Given an SRR accession like SRR1929796 <a href="https://trace.ncbi.nlm.nih.gov/Traces/sra/?run=SRR1929796" rel="nofollow noreferrer">https://trace.ncbi.nlm.nih.gov/Traces/sra/?run=SRR1929796</a></p>
  <p>Is there a metadata API / source that can tell me which google cloud bucket to retrieve the data from like they show on the website?</p>
  <pre><code>gs://sra-pub-crun-4/SRR1929796/SRR1929796.1
  </code></pre>
  <p>It also sounds like fastq-dump and fasterq-dump can be configured with Google Cloud credentials to download that for me.</p>
  <p>I'm just wondering is there a way to determine the google cloud storage bucket path it's in <code>gs://sra-pub-crun-4</code>?</p>
  
Tags: <fastq><sratoolkit><sra><cloud>
Title: How to determine NCBI's SRS google cloud bucket or AWS bucket
ThreadText: # How to determine NCBI's SRS google cloud bucket or AWS bucket
  
  (Asked by: username_0 on 2021-08-24)
  
  It appears that AWS and GCP host SRA data and it's beneficial to grab the data from that source when running on GCP for example.
  
  Given an SRR accession like SRR1929796 <https://trace.ncbi.nlm.nih.gov/Traces/sra/?run=SRR1929796>
  
  Is there a metadata API / source that can tell me which google cloud bucket to retrieve the data from like they show on the website?
  
  ```
  gs://sra-pub-crun-4/SRR1929796/SRR1929796.1
  
  ```
  
  It also sounds like fastq-dump and fasterq-dump can be configured with Google Cloud credentials to download that for me.
  
  I'm just wondering is there a way to determine the google cloud storage bucket path it's in `gs://sra-pub-crun-4`?
  
  **Tags:** fastq, sratoolkit, sra, cloud
  
  
  ---
  
  ## 1 answers
  
  ### Answer by username_1 on 2022-03-29. Score: 0
  
  It sounds like it to me too. I have never directly accessed NCBIs stuff via Google buckets and I don't know what permissions they are setting for direct access.
  
  So ... I briefly checked it out
  
  ```
  gsutil ls gs://sra-pub-crun-4
  
  ```
  
  and 'yes' its possible but ...
  
  > BadRequestException: 400 Bucket is a requester pays bucket but no user project provided.
  
  'Requester pay' luckily I wasn't logged in :-)
  
  What the message implies given access to your (my) GCP account and they'll bill you (me). I don't think it will be much, particularly for a 'list' request, however I ain't gonna find out for a data set I don't need. I do doubt I'm going to get billed for 'list' request, however I've never paid 'list' request I prefer to keep it that way. In contrast, NCBI's front-end is free and thats what they want, because they could of course set the bucket so they pay.
  
  So in answer the question, if you wanna pay go ahead ... dial up a GCP account link it to pay.
  
  ---
  
  Here's my first answer
  
  Please note I'm not really certain what information the OP seeks here, e.g. gs:// locations type stuff. *If the question is where's the SRS database on every gs:// path ...* I don't know.
  
  I think the OP wants an API ... Google Cloud certainly use APIs by the bucket load (no pun intended but I thought it was funny). I don't use them because they are excessively verbose and I prefer SDK and gcloud tools, of which `gsutil` is one.
  
  > It also sounds like fastq-dump and fasterq-dump can be configured with Google Cloud credentials to download that for me.
  
  If I have understood correctly and that is all you want then sure
  
  ```
  gsutil cp gs://sra-pub-crun-4/SRR1929796/SRR1929796.1 .
  
  ```
  
  will do it, if permitted (or in hindsight prepared to pay) and there will be an API version of this.
  
  ---
  
  **Background**
  
  Installation via Google's `Cloud SDK`, via <https://cloud.google.com/storage/docs/gsutil_install#install>
  
  
  ---
  
  