content.raw: How do i access llama 3.1 70b in my space ?
content.type: text
content.value: How do i access llama 3.1 70b in my space ?
content.type: new_line
content.type: new_line
content.raw: this doesn't seem to work, can someone help me with a working code 
content.type: text
content.value: this doesn't seem to work, can someone help me with a working code 
content.type: new_line
content.type: new_line
content.type: new_line
content.raw: from transformers import AutoConfig
content.type: text
content.value: from transformers import AutoConfig
content.type: new_line
content.type: new_line
content.raw: config = AutoConfig.from_pretrained("meta-llama/Meta-Llama-3.1-70B", revision="main")
content.type: text
content.value: config = AutoConfig.from_pretrained("meta-llama/Meta-Llama-3.1-70B", revision="main")
content.type: new_line
content.raw: config.rope_scaling = {"type": "llama3", "factor": 8.0}
content.type: text
content.value: config.rope_scaling = {"type": "llama3", "factor": 8.0}
content.type: new_line
content.type: new_line
content.raw: model = AutoModelForCausalLM.from_pretrained("meta-llama/Meta-Llama-3.1-70B", config=config, use_auth_token=True)
content.type: text
content.value: model = AutoModelForCausalLM.from_pretrained("meta-llama/Meta-Llama-3.1-70B", config=config, use_auth_token=True)
rawContent: How do i access llama 3.1 70b in my space ?
  
  this doesn't seem to work, can someone help me with a working code 
  
  
  from transformers import AutoConfig
  
  config = AutoConfig.from_pretrained("meta-llama/Meta-Llama-3.1-70B", revision="main")
  config.rope_scaling = {"type": "llama3", "factor": 8.0}
  
  model = AutoModelForCausalLM.from_pretrained("meta-llama/Meta-Llama-3.1-70B", config=config, use_auth_token=True)
reactions.reaction: 👀
reactions.users: John6666
commentators._id: 6640bbd0220cfa8cbfdce080
commentators.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/6640bbd0220cfa8cbfdce080/wiAHUu5ewawyipNs0YFBR.png
commentators.fullname: John Smith
commentators.name: John6666
commentators.type: user
commentators._id: 6611d508b5e6420d0307487d
commentators.avatarUrl: /avatars/fcf9eac61e0ec82ba5503bf07c867247.svg
commentators.fullname: Rangaiah
commentators.name: Shamurangaiah
commentators.type: user