text: Title: inital list of Requests dont all get handled?
  Body: request queue not being handled. So when i have a list of Requests with different labels it will only handle the labels of the first request it sees. Am I doing something wrong or is this a bug?
  
  Here in the logs I queue up 4 things
  ```
  DEBUG Added 4 requests to the queue, response: processed_requests=[ProcessedRequest(id='WCJHwnKoF1xWGYF', unique_key='https://URL1', was_already_present=False, was_already_handled=False), ProcessedRequest(id='ntWUsKSPofbfOU2', unique_key='https://URL2', was_already_present=False, was_already_handled=False), ProcessedRequest(id='xMI8mB7yETk8KJz', unique_key='https://URL3', was_already_present=False, was_already_handled=False), ProcessedRequest(id='2iT82Knl0Rr4qEi', unique_key='https://en.wikipedia.org/wiki/cgroups', was_already_present=False, was_already_handled=False)] unprocessed_requests=[]
  [crawlee.memory_storage_client._memory_storage_client] DEBUG Storage was already purged on start.
  [crawlee._autoscaling.autoscaled_pool] DEBUG Starting the pool
  ```
  
  but then it only process the first 2 with label=JSON
  ```
  │ requests_finished             │ 2        │
  │ requests_failed               │ 0        │
  │ retry_histogram               │ [2]      │
  │ request_avg_failed_duration   │ None     │
  │ request_avg_finished_duration │ 1.623642 │
  │ requests_finished_per_minute  │ 63       │
  │ requests_failed_per_minute    │ 0        │
  │ request_total_duration        │ 3.247283 │
  │ requests_total                │ 2        │
  │ crawler_runtime               │ 1.919938 │
  ```
  
  
  Heres my list i sent to get queued.NOw the strange thing is if i comment out the first two Request the other two work. and when i put the HTML lable on top 
  ```python
  [
      Request.from_url(
          url="https://sightmap.com/app/api/v1/8epml7q1v6d/sightmaps/80524",
          label="JSON",
          user_data={"building_id": 1},
      ),
      Request.from_url(
          url="https://sightmap.com/app/api/v1/60p7q39nw7n/sightmaps/397",
          label="JSON",
          user_data={"building_id": 2},
      ),
      Request.from_url(
          url="https://www.windsorcommunities.com/properties/windsor-on-the-lake/floorplans/",
          label="HTML",
          user_data={"building_id": 3},
      ),
          Request.from_url(
          url="https://en.wikipedia.org/wiki/Cgroups",
          label="HTML",
          user_data={"building_id": 3},
      ),
  ]
  ```
  
  Heres my router.py handlers 
  ```python
  @router.default_handler
  async def default_handler(context: BeautifulSoupCrawlingContext) -> None:
      """Default request handler."""
      building_id = context.request.user_data.model_extra.get("building_id")
      logger.info("PASSING", url={context.request.url}, building_id=building_id)
  
  
  @router.handler("HTML")
  async def html_handler(context: BeautifulSoupCrawlingContext) -> None:
      """Default request handler."""
      building_id = context.request.user_data.model_extra.get("building_id")
      logger.info("Handling", url={context.request.url}, building_id=building_id)
      http_response = context.http_response
      content = http_response.read() if http_response else None
      if content:
          try:
              content_str = content.decode("utf-8")
              # BeautifulSoup will fixes invalid HTML
              if content_str == str(BeautifulSoup(content_str, "html.parser")):
                  logger.error("Invalid HTML content.")
                  raise Exception("Invalid HTML content.")
              else:
                  logger.debug("Valid HTML content.")
          except Exception as e:
              logger.error(
                  "An error occurred while parsing HTML content.",
                  error=str(e),
                  url=context.request.url,
              )
              raise e
      else:
          # Not sure if none content is already handled by crawlee doesn't hurt to have it here
          logger.error("No content fetched.", url=context.request.url)
          raise Exception("No content fetched.")
  
      await save_scrape_response(context, content_str)
  
  
  @router.handler("JSON")
  async def json_handler(context: BeautifulSoupCrawlingContext) -> None:
      """Default request handler."""
      building_id = context.request.user_data.model_extra.get("building_id")
      logger.info("Handling", url={context.request.url}, building_id=building_id)
      http_response = context.http_response
      try:
          json_content = json.load(http_response)
      except json.JSONDecodeError:
          json_content = None
          logger.error("Invalid JSON content.", url=context.request.url)
      # We should save invalid page for debugging?
      # They get saved in the logs maybe future we pump them to a bad_responses bucket?
      await save_scrape_response(context, json_content)
  ```
  
  
  <details><summary>Logs</summary>
  <p>
  
  ```
  DEBUG Added 4 requests to the queue, response: processed_requests=[ProcessedRequest(id='WCJHwnKoF1xWGYF', unique_key='https://URL1', was_already_present=False, was_already_handled=False), ProcessedRequest(id='ntWUsKSPofbfOU2', unique_key='https://URL2', was_already_present=False, was_already_handled=False), ProcessedRequest(id='xMI8mB7yETk8KJz', unique_key='https://URL3', was_already_present=False, was_already_handled=False), ProcessedRequest(id='2iT82Knl0Rr4qEi', unique_key='https://en.wikipedia.org/wiki/cgroups', was_already_present=False, was_already_handled=False)] unprocessed_requests=[]
  [crawlee.memory_storage_client._memory_storage_client] DEBUG Storage was already purged on start.
  [crawlee._autoscaling.autoscaled_pool] DEBUG Starting the pool
  [crawlee.beautifulsoup_crawler._beautifulsoup_crawler] INFO  Current request statistics:
  ┌───────────────────────────────┬──────────┐
  │ requests_finished             │ 0        │
  │ requests_failed               │ 0        │
  │ retry_histogram               │ [0]      │
  │ request_avg_failed_duration   │ None     │
  │ request_avg_finished_duration │ None     │
  │ requests_finished_per_minute  │ 0        │
  │ requests_failed_per_minute    │ 0        │
  │ request_total_duration        │ 0.0      │
  │ requests_total                │ 0        │
  │ crawler_runtime               │ 0.013797 │
  └───────────────────────────────┴──────────┘
  [crawlee._autoscaling.autoscaled_pool] INFO  current_concurrency = 0; desired_concurrency = 2; cpu = 0; mem = 0; event_loop = 0.0; client_info = 0.0
  [crawlee._utils.system] DEBUG Calling get_cpu_info()...
  [crawlee.events._event_manager] DEBUG LocalEventManager.on.listener_wrapper(): Awaiting listener task...
  [crawlee.statistics._statistics] DEBUG Persisting state of the Statistics (event_data=is_migrating=False).
  [crawlee.events._event_manager] DEBUG LocalEventManager.on.listener_wrapper(): Listener task completed.
  [crawlee.events._event_manager] DEBUG LocalEventManager.on.listener_wrapper(): Removing listener task from the set...
  [crawlee.storages._request_queue] DEBUG Queue head still returned requests that need to be processed (or that are locked by other clients)
  [crawlee._autoscaling.autoscaled_pool] DEBUG Scheduling a new task
  [crawlee.storages._request_queue] DEBUG There are still ids in the queue head that are pending processing ({"queue_head_ids_pending": 4})
  [crawlee._autoscaling.autoscaled_pool] DEBUG Scheduling a new task
  [crawlee.storages._request_queue] DEBUG There are still ids in the queue head that are pending processing ({"queue_head_ids_pending": 4})
  [crawlee._autoscaling.autoscaled_pool] DEBUG Not scheduling new tasks - already running at desired concurrency
  [httpx] DEBUG load_ssl_context verify=True cert=None trust_env=True http2=False
  [httpx] DEBUG load_verify_locations cafile='/home/vscode/.cache/pypoetry/virtualenvs/bs-crawler-7DgAT4g4-py3.12/lib/python3.12/site-packages/certifi/cacert.pem'
  [httpcore.connection] DEBUG connect_tcp.started host='sightmap.com' port=443 local_address=None timeout=5.0 socket_options=None
  [httpcore.connection] DEBUG connect_tcp.complete return_value=<httpcore._backends.anyio.AnyIOStream object at 0xffff8df70980>
  [httpcore.connection] DEBUG start_tls.started ssl_context=<ssl.SSLContext object at 0xffff8e1b9550> server_hostname='sightmap.com' timeout=5.0
  [crawlee._utils.system] DEBUG Calling get_memory_info()...
  [crawlee.events._event_manager] DEBUG LocalEventManager.on.listener_wrapper(): Awaiting listener task...
  [crawlee.events._event_manager] DEBUG LocalEventManager.on.listener_wrapper(): Awaiting listener task...
  [crawlee.events._event_manager] DEBUG LocalEventManager.on.listener_wrapper(): Listener task completed.
  [crawlee.events._event_manager] DEBUG LocalEventManager.on.listener_wrapper(): Removing listener task from the set...
  [crawlee.events._event_manager] DEBUG LocalEventManager.on.listener_wrapper(): Listener task completed.
  [crawlee.events._event_manager] DEBUG LocalEventManager.on.listener_wrapper(): Removing listener task from the set...
  [httpcore.connection] DEBUG start_tls.complete return_value=<httpcore._backends.anyio.AnyIOStream object at 0xffff8df73800>
  [httpcore.http2] DEBUG send_connection_init.started request=<Request [b'GET']>
  [httpcore.http2] DEBUG send_connection_init.complete
  [httpcore.http2] DEBUG send_request_headers.started request=<Request [b'GET']> stream_id=1
  [hpack.hpack] DEBUG Adding (b':method', b'GET') to the header table, sensitive:False, huffman:True
  [hpack.hpack] DEBUG Encoding 2 with 7 bits
  [hpack.hpack] DEBUG Adding (b':authority', b'sightmap.com') to the header table, sensitive:False, huffman:True
  [hpack.hpack] DEBUG Encoding 1 with 6 bits
  [hpack.hpack] DEBUG Encoding 9 with 7 bits
  [hpack.hpack] DEBUG Adding (b':scheme', b'https') to the header table, sensitive:False, huffman:True
  [hpack.hpack] DEBUG Encoding 7 with 7 bits
  [hpack.hpack] DEBUG Adding (b':path', b'/app/api/v1/8epml7q1v6d/sightmaps/80524') to the header table, sensitive:False, huffman:True
  [hpack.hpack] DEBUG Encoding 4 with 6 bits
  [hpack.hpack] DEBUG Encoding 28 with 7 bits
  [hpack.hpack] DEBUG Adding (b'accept-encoding', b'gzip, deflate, br') to the header table, sensitive:False, huffman:True
  [hpack.hpack] DEBUG Encoding 16 with 6 bits
  [hpack.hpack] DEBUG Encoding 13 with 7 bits
  [hpack.hpack] DEBUG Adding (b'accept', b'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7') to the header table, sensitive:False, huffman:True
  [hpack.hpack] DEBUG Encoding 19 with 6 bits
  [hpack.hpack] DEBUG Encoding 101 with 7 bits
  [hpack.hpack] DEBUG Adding (b'accept-language', b'en-US,en;q=0.9') to the header table, sensitive:False, huffman:True
  [hpack.hpack] DEBUG Encoding 17 with 6 bits
  [hpack.hpack] DEBUG Encoding 11 with 7 bits
  [hpack.hpack] DEBUG Adding (b'user-agent', b'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/75.0.3770.142 Safari/537.36') to the header table, sensitive:False, huffman:True
  [hpack.hpack] DEBUG Encoding 58 with 6 bits
  [hpack.hpack] DEBUG Encoding 92 with 7 bits
  [hpack.hpack] DEBUG Encoded header block to b'\x82A\x89A\xa6\x9d4\x8e\xb5\xc8z\x7f\x87D\x9c`u\xd6\xc0\xeb3\x1d\xc2\xc3\xc5\xae\x9a\x1d\xec\x1e\xeeH\xc2\r4\xe9\xa4u\xa1\x87\x80\xd8\x9aP\x8d\x9b\xd9\xab\xfaRB\xcb@\xd2_\xa5#\xb3S\xe5I|\xa5\x89\xd3M\x1fC\xae\xba\x0cA\xa4\xc7\xa9\x8f3\xa6\x9a?\xdf\x9ah\xfa\x1du\xd0b\r&=Ly\xa6\x8f\xbe\xd0\x01w\xfe\x8dH\xe6+\x03\xeei~\x8dH\xe6+\x1e\x0b\x1d\x7fF\xa4s\x15\x81\xd7T\xdf_,|\xfd\xf6\x80\x0b\xbd\xf4:\xeb\xa0\xc4\x1aLz\x98A\xa6\xa8\xb2,_$\x9cuL_\xbe\xf0F\xcf\xdfh\x00\xbb\xbfQ\x8b-Kp\xdd\xf4Z\xbe\xfb@\x05\xdfz\xdc\xd0\x7ff\xa2\x81\xb0\xda\xe0S\xfa\xd02\x1a\xa4\x9d\x13\xfd\xa9\x92\xa4\x96\x854\x0c\x8aj\xdc\xa7\xe2\x81\x04Aj \xffjC]t\x17\x91c\xccd\xb0\xdb.\xae\xcb\x8a\x7fY\xb1\xef\xd1\x9f\xe9J\r\xd4\xaab):\x9f\xfbR\xf4\xf6\x1e\x92\xb0\xebk\x81v]t\x0b\x85\xa1)\xb8r\x8e\xc30\xdb.\xae\xcb\x9f'
  [httpcore.http2] DEBUG send_request_headers.complete
  [httpcore.http2] DEBUG send_request_body.started request=<Request [b'GET']> stream_id=1
  [httpcore.http2] DEBUG send_request_body.complete
  [httpcore.http2] DEBUG receive_response_headers.started request=<Request [b'GET']> stream_id=1
  [httpcore.http2] DEBUG receive_remote_settings.started
  [httpcore.http2] DEBUG receive_remote_settings.complete return_value=<RemoteSettingsChanged changed_settings:{ChangedSetting(setting=3, original_value=None, new_value=128), ChangedSetting(setting=4, original_value=65535, new_value=65536), ChangedSetting(setting=5, original_value=16384, new_value=16777215)}>
  [httpcore.http2] DEBUG send_request_headers.started request=<Request [b'GET']> stream_id=3
  [hpack.hpack] DEBUG Adding (b':method', b'GET') to the header table, sensitive:False, huffman:True
  [hpack.hpack] DEBUG Encoding 2 with 7 bits
  [hpack.hpack] DEBUG Adding (b':authority', b'sightmap.com') to the header table, sensitive:False, huffman:True
  [hpack.hpack] DEBUG Encoding 67 with 7 bits
  [hpack.hpack] DEBUG Adding (b':scheme', b'https') to the header table, sensitive:False, huffman:True
  [hpack.hpack] DEBUG Encoding 7 with 7 bits
  [hpack.hpack] DEBUG Adding (b':path', b'/app/api/v1/60p7q39nw7n/sightmaps/397') to the header table, sensitive:False, huffman:True
  [hpack.hpack] DEBUG Encoding 4 with 6 bits
  [hpack.hpack] DEBUG Encoding 27 with 7 bits
  [hpack.hpack] DEBUG Adding (b'accept-encoding', b'gzip, deflate, br') to the header table, sensitive:False, huffman:True
  [hpack.hpack] DEBUG Encoding 66 with 7 bits
  [hpack.hpack] DEBUG Adding (b'accept', b'text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,*/*;q=0.8,application/signed-exchange;v=b3;q=0.7') to the header table, sensitive:False, huffman:True
  [hpack.hpack] DEBUG Encoding 65 with 7 bits
  [hpack.hpack] DEBUG Adding (b'accept-language', b'en-US,en;q=0.9') to the header table, sensitive:False, huffman:True
  [hpack.hpack] DEBUG Encoding 64 with 7 bits
  [hpack.hpack] DEBUG Adding (b'user-agent', b'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/75.0.3770.142 Safari/537.36') to the header table, sensitive:False, huffman:True
  [hpack.hpack] DEBUG Encoding 63 with 7 bits
  [hpack.hpack] DEBUG Encoded header block to b'\x82\xc3\x87D\x9b`u\xd6\xc0\xeb3\x1d\xc2\xc3\x80\xad\xde\xcc\xbfW\x87ja\x06\x9at\xd2:\xd0\xc3/\xbb\xc2\xc1\xc0\xbf'
  [httpcore.http2] DEBUG send_request_headers.complete
  [httpcore.http2] DEBUG send_request_body.started request=<Request [b'GET']> stream_id=3
  [httpcore.http2] DEBUG send_request_body.complete
  [httpcore.http2] DEBUG receive_response_headers.started request=<Request [b'GET']> stream_id=3
  [hpack.hpack] DEBUG Decoding b' \x88a\x96\xdc4\xfd( \xa9|\xa4P@\x13J\x05\xfb\x80\r\xc1>\xa6-\x1b\xff_\x8b\x1du\xd0b\r&=LtA\xea\x00\x85Al\xee[?\x84\xaacU\xe7\x00\x04vary\x8b\x84\x84-i[\x05D<\x86\xaao\x00\x89 \xc99V!\xeaM\x87\xa3\x8c\xa8\xeb\x10d\x9c\xbfJWa\xbb\x8d%\x00\x8b!\xeaIjJ\xc5\xa8\x87\x90\xd5M\x83\x9b\xd9\xab'
  [hpack.hpack] DEBUG Decoded 0, consumed 1 bytes
  [hpack.table] DEBUG Resizing header table to 0 from 4096
  [hpack.hpack] DEBUG Decoded 8, consumed 1 bytes
  [hpack.hpack] DEBUG Decoded (b':status', b'200'), consumed 1
  [hpack.hpack] DEBUG Decoded 33, consumed 1 bytes
  [hpack.hpack] DEBUG Decoded 22, consumed 1 bytes
  [hpack.hpack] DEBUG Decoded (b'date', b'Sat, 21 Dec 2024 19:01:29 GMT'), total consumed 24 bytes, indexed True
  [hpack.hpack] DEBUG Decoded 31, consumed 1 bytes
  [hpack.hpack] DEBUG Decoded 11, consumed 1 bytes
  [hpack.hpack] DEBUG Decoded (b'content-type', b'application/json'), total consumed 13 bytes, indexed True
  [hpack.hpack] DEBUG Decoded 5, consumed 1 bytes
  [hpack.hpack] DEBUG Decoded 4, consumed 1 bytes
  [hpack.hpack] DEBUG Decoded (b'server', b'nginx'), total consumed 12 bytes, indexed False
  [hpack.hpack] DEBUG Decoded 4, consumed 1 bytes
  [hpack.hpack] DEBUG Decoded 11, consumed 1 bytes
  [hpack.hpack] DEBUG Decoded (<memory at 0xffff8dfd0c40>, b'Accept-Encoding'), total consumed 18 bytes, indexed False
  [hpack.hpack] DEBUG Decoded 9, consumed 1 bytes
  [hpack.hpack] DEBUG Decoded 12, consumed 1 bytes
  [hpack.hpack] DEBUG Decoded (b'cache-control', b'no-cache, private'), total consumed 24 bytes, indexed False
  [hpack.hpack] DEBUG Decoded 11, consumed 1 bytes
  [hpack.hpack] DEBUG Decoded 3, consumed 1 bytes
  [hpack.hpack] DEBUG Decoded (b'content-encoding', b'gzip'), total consumed 17 bytes, indexed False
  [httpcore.http2] DEBUG receive_response_headers.complete return_value=(200, [(b'date', b'Sat, 21 Dec 2024 19:01:29 GMT'), (b'content-type', b'application/json'), (b'server', b'nginx'), (b'vary', b'Accept-Encoding'), (b'cache-control', b'no-cache, private'), (b'content-encoding', b'gzip')])
  [httpx] INFO  HTTP Request: GET https://URL1 "HTTP/2 200 OK"
  [httpcore.http2] DEBUG receive_response_body.started request=<Request [b'GET']> stream_id=1
  [hpack.hpack] DEBUG Decoding b'\x88a\x96\xdc4\xfd( \xa9|\xa4P@\x13J\x05\xfb\x80\r\xc1>\xa6-\x1b\xff_\x8b\x1du\xd0b\r&=LtA\xea\x00\x85Al\xee[?\x84\xaacU\xe7\x00\x04vary\x8b\x84\x84-i[\x05D<\x86\xaao\x00\x89 \xc99V!\xeaM\x87\xa3\x8c\xa8\xeb\x10d\x9c\xbfJWa\xbb\x8d%\x00\x8b!\xeaIjJ\xc5\xa8\x87\x90\xd5M\x83\x9b\xd9\xab'
  [hpack.hpack] DEBUG Decoded 8, consumed 1 bytes
  [hpack.hpack] DEBUG Decoded (b':status', b'200'), consumed 1
  [hpack.hpack] DEBUG Decoded 33, consumed 1 bytes
  [hpack.hpack] DEBUG Decoded 22, consumed 1 bytes
  [hpack.hpack] DEBUG Decoded (b'date', b'Sat, 21 Dec 2024 19:01:29 GMT'), total consumed 24 bytes, indexed True
  [hpack.hpack] DEBUG Decoded 31, consumed 1 bytes
  [hpack.hpack] DEBUG Decoded 11, consumed 1 bytes
  [hpack.hpack] DEBUG Decoded (b'content-type', b'application/json'), total consumed 13 bytes, indexed True
  [hpack.hpack] DEBUG Decoded 5, consumed 1 bytes
  [hpack.hpack] DEBUG Decoded 4, consumed 1 bytes
  [hpack.hpack] DEBUG Decoded (b'server', b'nginx'), total consumed 12 bytes, indexed False
  [hpack.hpack] DEBUG Decoded 4, consumed 1 bytes
  [hpack.hpack] DEBUG Decoded 11, consumed 1 bytes
  [hpack.hpack] DEBUG Decoded (<memory at 0xffff8ddf4580>, b'Accept-Encoding'), total consumed 18 bytes, indexed False
  [hpack.hpack] DEBUG Decoded 9, consumed 1 bytes
  [hpack.hpack] DEBUG Decoded 12, consumed 1 bytes
  [hpack.hpack] DEBUG Decoded (b'cache-control', b'no-cache, private'), total consumed 24 bytes, indexed False
  [hpack.hpack] DEBUG Decoded 11, consumed 1 bytes
  [hpack.hpack] DEBUG Decoded 3, consumed 1 bytes
  [hpack.hpack] DEBUG Decoded (b'content-encoding', b'gzip'), total consumed 17 bytes, indexed False
  [httpcore.http2] DEBUG receive_response_body.complete
  [httpcore.http2] DEBUG response_closed.started stream_id=1
  [httpcore.http2] DEBUG receive_response_headers.complete return_value=(200, [(b'date', b'Sat, 21 Dec 2024 19:01:29 GMT'), (b'content-type', b'application/json'), (b'server', b'nginx'), (b'vary', b'Accept-Encoding'), (b'cache-control', b'no-cache, private'), (b'content-encoding', b'gzip')])
  [httpx] INFO  HTTP Request: GET https://URL2 "HTTP/2 200 OK"
  [httpcore.http2] DEBUG receive_response_body.started request=<Request [b'GET']> stream_id=3
  [httpcore.http2] DEBUG response_closed.complete
  [httpcore.http2] DEBUG receive_response_body.complete
  [httpcore.http2] DEBUG response_closed.started stream_id=3
  [httpcore.http2] DEBUG response_closed.complete
  [crawlee.storages._request_queue] DEBUG There are still ids in the queue head that are pending processing ({"queue_head_ids_pending": 2})
  [crawlee._autoscaling.autoscaled_pool] DEBUG Not scheduling new tasks - already running at desired concurrency
  {"url": "{'https://URL2'}", "building_id": 2, "message": "Handling", "time": "2024-12-21T19:01:29.725513Z", "severity": "INFO", "logging.googleapis.com/sourceLocation": {"file": "/workspaces/AustinRent/scraper/scraper/routes.py", "line": "99", "function": "routes:json_handler"}}
  [urllib3.util.retry] DEBUG Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None)
  [urllib3.connectionpool] DEBUG Starting new HTTPS connection (1): oauth2.googleapis.com:443
  [urllib3.connectionpool] DEBUG https://oauth2.googleapis.com:443 "POST /token HTTP/11" 200 None
  [urllib3.connectionpool] DEBUG Starting new HTTPS connection (1): storage.googleapis.com:443
  [urllib3.connectionpool] DEBUG https://storage.googleapis.com:443 "POST /upload/storage/v1/b/scraper-responses/o?uploadType=multipart HTTP/11" 200 968
  {"destination_blob_name": "0193ea98-99ff-8c6e-b37f-cfd9e7568bb1.json", "building_id": 2, "message": "String content uploaded", "time": "2024-12-21T19:01:30.056656Z", "severity": "INFO", "logging.googleapis.com/sourceLocation": {"file": "/workspaces/AustinRent/scraper/scraper/utils/bucket_utils.py", "line": "32", "function": "bucket_utils:upload_string_to_gcs"}}
  2024-12-21 19:01:30,068 INFO sqlalchemy.engine.Engine BEGIN (implicit)
  [sqlalchemy.engine.Engine] INFO  BEGIN (implicit) ({"message": "BEGIN (implicit)", "asctime": "2024-12-21 19:01:30,068"})
  2024-12-21 19:01:30,079 INFO sqlalchemy.engine.Engine INSERT INTO scrape_responses (file_id, requested_url, loaded_url, building_id, retry_count) VALUES ($1::UUID, $2::VARCHAR, $3::VARCHAR, $4::INTEGER, $5::INTEGER) RETURNING scrape_responses.scrape_page_id, scrape_responses.created_at
  [sqlalchemy.engine.Engine] INFO  INSERT INTO scrape_responses (file_id, requested_url, loaded_url, building_id, retry_count) VALUES ($1::UUID, $2::VARCHAR, $3::VARCHAR, $4::INTEGER, $5::INTEGER) RETURNING scrape_responses.scrape_page_id, scrape_responses.created_at ({"message": "INSERT INTO scrape_responses (file_id, requested_url, loaded_url, building_id, retry_count) VALUES ($1::UUID, $2::VARCHAR, $3::VARCHAR, $4::INTEGER, $5::INTEGER) RETURNING scrape_responses.scrape_page_id, scrape_responses.created_at", "asctime": "2024-12-21 19:01:30,079"})
  2024-12-21 19:01:30,079 INFO sqlalchemy.engine.Engine [generated in 0.00081s] (UUID('0193ea98-99ff-8c6e-b37f-cfd9e7568bb1'), 'https://URL2', 'https://URL2', 2, 0)
  [sqlalchemy.engine.Engine] INFO  [generated in 0.00081s] (UUID('0193ea98-99ff-8c6e-b37f-cfd9e7568bb1'), 'https://URL2', 'https://URL2', 2, 0) ({"message": "[generated in 0.00081s] (UUID('0193ea98-99ff-8c6e-b37f-cfd9e7568bb1'), 'https://URL2', 'https://URL2', 2, 0)", "asctime": "2024-12-21 19:01:30,079"})
  {"url": "{'https://URL1'}", "building_id": 1, "message": "Handling", "time": "2024-12-21T19:01:30.081275Z", "severity": "INFO", "logging.googleapis.com/sourceLocation": {"file": "/workspaces/AustinRent/scraper/scraper/routes.py", "line": "99", "function": "routes:json_handler"}}
  [urllib3.connectionpool] DEBUG https://storage.googleapis.com:443 "POST /upload/storage/v1/b/scraper-responses/o?uploadType=multipart HTTP/11" 200 968
  {"destination_blob_name": "0193ea98-9b69-8046-96af-dc9893ff15c6.json", "building_id": 1, "message": "String content uploaded", "time": "2024-12-21T19:01:30.332999Z", "severity": "INFO", "logging.googleapis.com/sourceLocation": {"file": "/workspaces/AustinRent/scraper/scraper/utils/bucket_utils.py", "line": "32", "function": "bucket_utils:upload_string_to_gcs"}}
  [crawlee.storages._request_queue] DEBUG There are still ids in the queue head that are pending processing ({"queue_head_ids_pending": 2})
  [crawlee._autoscaling.autoscaled_pool] DEBUG Not scheduling new tasks - system is overloaded
  [crawlee._utils.system] DEBUG Calling get_cpu_info()...
  2024-12-21 19:01:30,408 INFO sqlalchemy.engine.Engine COMMIT
  [sqlalchemy.engine.Engine] INFO  COMMIT ({"message": "COMMIT", "asctime": "2024-12-21 19:01:30,408"})
  [crawlee._utils.system] DEBUG Calling get_memory_info()...
  [crawlee.events._event_manager] DEBUG LocalEventManager.on.listener_wrapper(): Awaiting listener task...
  [crawlee.events._event_manager] DEBUG LocalEventManager.on.listener_wrapper(): Awaiting listener task...
  [crawlee.events._event_manager] DEBUG LocalEventManager.on.listener_wrapper(): Listener task completed.
  [crawlee.events._event_manager] DEBUG LocalEventManager.on.listener_wrapper(): Removing listener task from the set...
  [crawlee.events._event_manager] DEBUG LocalEventManager.on.listener_wrapper(): Listener task completed.
  [crawlee.events._event_manager] DEBUG LocalEventManager.on.listener_wrapper(): Removing listener task from the set...
  {"url": "{'https://URL2'}", "building_id": 2, "file_id": "UUID('0193ea98-99ff-8c6e-b37f-cfd9e7568bb1')", "message": "Scrape response saved to GCP.", "time": "2024-12-21T19:01:30.448841Z", "severity": "INFO", "logging.googleapis.com/sourceLocation": {"file": "/workspaces/AustinRent/scraper/scraper/routes.py", "line": "42", "function": "routes:save_scrape_response"}}
  [crawlee._autoscaling.autoscaled_pool] DEBUG Worker task finished
  [crawlee.storages._request_queue] DEBUG There are still ids in the queue head that are pending processing ({"queue_head_ids_pending": 2})
  [crawlee.beautifulsoup_crawler._beautifulsoup_crawler] INFO  The crawler has reached its limit of 1 requests per crawl. All ongoing requests have now completed. Total requests processed: 1. The crawler will now shut down.
  [crawlee._autoscaling.autoscaled_pool] DEBUG `is_finished_function` reports that we are finished
  [crawlee._autoscaling.autoscaled_pool] DEBUG Terminating - waiting for tasks to complete
  2024-12-21 19:01:30,764 INFO sqlalchemy.engine.Engine BEGIN (implicit)
  [sqlalchemy.engine.Engine] INFO  BEGIN (implicit) ({"message": "BEGIN (implicit)", "asctime": "2024-12-21 19:01:30,764"})
  2024-12-21 19:01:30,765 INFO sqlalchemy.engine.Engine INSERT INTO scrape_responses (file_id, requested_url, loaded_url, building_id, retry_count) VALUES ($1::UUID, $2::VARCHAR, $3::VARCHAR, $4::INTEGER, $5::INTEGER) RETURNING scrape_responses.scrape_page_id, scrape_responses.created_at
  [sqlalchemy.engine.Engine] INFO  INSERT INTO scrape_responses (file_id, requested_url, loaded_url, building_id, retry_count) VALUES ($1::UUID, $2::VARCHAR, $3::VARCHAR, $4::INTEGER, $5::INTEGER) RETURNING scrape_responses.scrape_page_id, scrape_responses.created_at ({"message": "INSERT INTO scrape_responses (file_id, requested_url, loaded_url, building_id, retry_count) VALUES ($1::UUID, $2::VARCHAR, $3::VARCHAR, $4::INTEGER, $5::INTEGER) RETURNING scrape_responses.scrape_page_id, scrape_responses.created_at", "asctime": "2024-12-21 19:01:30,765"})
  2024-12-21 19:01:30,766 INFO sqlalchemy.engine.Engine [cached since 0.6874s ago] (UUID('0193ea98-9b69-8046-96af-dc9893ff15c6'), 'https://URL1', 'https://URL1', 1, 0)
  [sqlalchemy.engine.Engine] INFO  [cached since 0.6874s ago] (UUID('0193ea98-9b69-8046-96af-dc9893ff15c6'), 'https://URL1', 'https://URL1', 1, 0) ({"message": "[cached since 0.6874s ago] (UUID('0193ea98-9b69-8046-96af-dc9893ff15c6'), 'https://URL1', 'https://URL1', 1, 0)", "asctime": "2024-12-21 19:01:30,766"})
  2024-12-21 19:01:30,909 INFO sqlalchemy.engine.Engine COMMIT
  [sqlalchemy.engine.Engine] INFO  COMMIT ({"message": "COMMIT", "asctime": "2024-12-21 19:01:30,909"})
  {"url": "{'https://URL1'}", "building_id": 1, "file_id": "UUID('0193ea98-9b69-8046-96af-dc9893ff15c6')", "message": "Scrape response saved to GCP.", "time": "2024-12-21T19:01:30.946939Z", "severity": "INFO", "logging.googleapis.com/sourceLocation": {"file": "/workspaces/AustinRent/scraper/scraper/routes.py", "line": "42", "function": "routes:save_scrape_response"}}
  [crawlee._autoscaling.autoscaled_pool] DEBUG Worker task finished
  [crawlee._autoscaling.autoscaled_pool] DEBUG Worker tasks finished
  [crawlee._autoscaling.autoscaled_pool] INFO  Waiting for remaining tasks to finish
  [crawlee._autoscaling.autoscaled_pool] DEBUG Pool cleanup finished
  [crawlee.statistics._statistics] DEBUG Persisting state of the Statistics (event_data=is_migrating=False).
  [crawlee.beautifulsoup_crawler._beautifulsoup_crawler] INFO  Final request statistics:
  ┌───────────────────────────────┬──────────┐
  │ requests_finished             │ 2        │
  │ requests_failed               │ 0        │
  │ retry_histogram               │ [2]      │
  │ request_avg_failed_duration   │ None     │
  │ request_avg_finished_duration │ 1.623642 │
  │ requests_finished_per_minute  │ 63       │
  │ requests_failed_per_minute    │ 0        │
  │ request_total_duration        │ 3.247283 │
  │ requests_total                │ 2        │
  │ crawler_runtime               │ 1.919938 │
  └───────────────────────────────┴──────────┘
  ```
  
  </p>
  </details> 