Spaces:

blanchon
/

TiM

Running on Zero

Julien Blanchon commited on 13 days ago

Commit

ef1acb1

1 Parent(s): 0ed026e

Update

Files changed (1) hide show

tim/models/utils/text_encoders.py CHANGED Viewed

@@ -11,7 +11,7 @@ def load_text_encoder(text_encoder_dir, device, weight_dtype):
         tokenizer.padding_side = "right"
         text_encoder = Gemma3ForCausalLM.from_pretrained(
             text_encoder_dir,
-            attn_implementation="flash_attention_2",
             device_map="cpu",
             dtype=weight_dtype,
         ).model

         tokenizer.padding_side = "right"
         text_encoder = Gemma3ForCausalLM.from_pretrained(
             text_encoder_dir,
+            attn_implementation="sdpa",
             device_map="cpu",
             dtype=weight_dtype,
         ).model