job: extension
config:
  name: flux_lora
  process:
  - type: sd_trainer
    training_folder: output
    performance_log_every: 1000
    device: cuda:0
    network:
      type: lora
      rank: 32
      linear: 32
      linear_alpha: 64
    save:
      dtype: bf16
      save_every: 1000
      max_step_saves_to_keep: 2
      push_to_hub: false
    datasets:
    - folder_path: /pvc/MIMIC_ARRANGED/Train
      caption_ext: txt
      caption_dropout_rate: 0.05
      shuffle_tokens: false
      cache_latents_to_disk: false
      resolution:
      - 512
      - 768
      - 1024
    train:
      batch_size: 16
      steps: 28505
      gradient_accumulation_steps: 2
      train_unet: true
      train_text_encoder: false
      gradient_checkpointing: true
      noise_scheduler: flowmatch
      optimizer: adamw8bit
      lr: 0.0001
      skip_first_sample: true
      disable_sampling: true
      ema_config:
        use_ema: true
        ema_decay: 0.99
      dtype: bf16
    model:
      name_or_path: black-forest-labs/FLUX.1-dev
      is_flux: true
      quantize: true
    sample:
      sampler: flowmatch
      sample_every: 2000
      width: 1024
      height: 1024
      prompts:
      - Nasogastric tube extends to the mid body of the stomach, before coiling on
        itself so that the tip lies close to the esophagogastric junction. Cardiac
        silhouette is within normal limits and there is no vascular congestion, pleural
        effusion, or acute focal pneumonia.
      - PA and lateral views of the chest provided. Lung volumes are low with mild
        bibasilar atelectasis. No convincing signs of pneumonia or edema. No large
        effusion or pneumothorax is seen. The cardiomediastinal silhouette appears
        normal. There is no free air below the right hemidiaphragm. Fluid level is
        noted within the stomach.
      - PA and lateral views of the chest provided. Lung volumes are low with mild
        bibasilar atelectasis. No convincing signs of pneumonia or edema. No large
        effusion or pneumothorax is seen. The cardiomediastinal silhouette appears
        normal. There is no free air below the right hemidiaphragm. Fluid level is
        noted within the stomach.
      - Heart size top-normal. Lungs grossly clear. No pleural abnormality or evidence
        of central lymph node enlargement.
      - The right costophrenic angle is not imaged. Otherwise, the lungs are clear.
        The heart size is upper limits of normal. Enteric tube courses below the level
        of the diaphragm. There is no pneumothorax.
      - Single frontal view of the chest. NG tube is coiled in the stomach. Right
        PICC in lower SVC is unchanged in position. Cardiac size is normal. Mild bibasilar
        opacities consistent with atelectasis. There is no pneumothorax or pleural
        effusion.
      - AP upright and lateral views of the chest provided. Mild basal atelectasis
        noted. Hilar congestion noted without frank edema. No large effusion or pneumothorax.
        Heart size is normal. Mediastinal contour is unchanged. Bony structures are
        intact. No free air below the right hemidiaphragm.
      - No focal consolidation, pleural effusion, pneumothorax, or pulmonary edema
        is detected. Heart and mediastinal contours are within normal limits. Aortic
        arch calcifications are seen.
      - Lung volumes are slightly low. This accentuates the size of the cardiac silhouette
        which is likely top normal. Mediastinal and hilar contours are unremarkable.
        Pulmonary vasculature is normal. No focal consolidation, pleural effusion
        or pneumothorax is present. There are mild degenerative changes in the thoracic
        spine.
      - The lungs are clear without focal consolidation. No pleural effusion or pneumothorax
        is seen. The cardiac and mediastinal silhouettes are unremarkable.
      neg: ''
      seed: 42
      walk_seed: true
      guidance_scale: 4
      sample_steps: 20
meta:
  name: flux_lora
  version: '1.0'