tiiuae/falcon-7b · Discussions

Custom 4-bit Finetuning 5-7 times faster inference than QLora

#13 opened about 2 years ago by

rmihaylov

How to make it work for less experienced AI whisperers

pinned

👍 4

17

#4 opened about 2 years ago by

Sloba

Support for LoRA?

pinned

👍 3

17

#3 opened about 2 years ago by

cekal

Fix for issue #104

#105 opened 10 months ago by

vebM

AttributeError: 'Logger' object has no attribute 'warning_once'

#104 opened 10 months ago by

vebM

Inference tensors cannot be saved for backward. To work around you can make a clone to get a normal tensor and use it in autograd.

3

#103 opened about 1 year ago by

Mubarak127

Two repeated errors in model output

1

#102 opened over 1 year ago by

virilo

ValueError: The current `device_map` had weights offloaded to the disk.

👍 4

#101 opened over 1 year ago by

MohamedZouabi

Why does falcon-7b have 71 attention heads?

🔥 3

2

#100 opened over 1 year ago by

alpindale

Creating vectordatabse using the falcon-7b model embeddings.

#99 opened over 1 year ago by

alchemistPS01

FalconForCausalLM does not support Flash Attention 2.0 yet

#98 opened over 1 year ago by

Menouar

Questions

#97 opened over 1 year ago by

Ppq62

Error while trying to load model

#96 opened over 1 year ago by

dwojcik

Adding `safetensors` variant of this model

#95 opened over 1 year ago by

SFconvertbot

Adding Evaluation Results

#94 opened over 1 year ago by

leaderboard-pr-bot

Model does not know when to stop generating text?

#93 opened over 1 year ago by

jashsayani

Could we machine translatation task using this model?

2

#91 opened over 1 year ago by

Pitambarmuduli

Falcon-7B decoding error

#90 opened over 1 year ago by

rahulseetharaman

[AUTOMATED] Model Memory Requirements

#89 opened almost 2 years ago by

model-sizer-bot

Upload configuration_RW.py

#88 opened almost 2 years ago by

imranshah

Upload configuration_RW.py

#87 opened almost 2 years ago by

imranshah

Getting: HTTPError: 404 Client Error: Not Found for url: https://huggingface.co/tiiuae/falcon-7b/resolve/main/configuration_RW.py

1

#86 opened almost 2 years ago by

f5-lolabhattu

What does this file do? modeling_falcon.py

#85 opened almost 2 years ago by

Tony068

Anyone discovered "Mini" yet in prompting?

#83 opened almost 2 years ago by

YoYo1234Qwerty

How to avoid running into memory/ storage problems associated with HF Spaces while using tiiuae/falcon-7b 0r 40b etc.,

4

#82 opened almost 2 years ago by

vsrinivas

Update generation_config.json

1

#81 opened almost 2 years ago by

nkasmanoff

ValueError: Unrecognized configuration class <class 'transformers_modules.falcon-7b.configuration_RW.RWConfig'> for this kind of AutoModel....

👍 1

2

#80 opened almost 2 years ago by

Inoob

RuntimeError: CUDA error: CUBLAS_STATUS_NOT_SUPPORTED

#79 opened almost 2 years ago by

ConorVanek

ImportError: Using `load_in_8bit=True` requires Accelerate

3

#78 opened almost 2 years ago by

aimananees

Adding `safetensors` variant of this model

#77 opened almost 2 years ago by

bikalnetomi

Use input attention mask instead of casual mask in attention

#76 opened almost 2 years ago by

CyberZHG

Question answering task with falcon model fails with "TypeError: forward() got an unexpected keyword argument 'token_type_ids'"

1

#75 opened almost 2 years ago by

karolzak13

Inaccurate number of parameters

😔 1

1

#74 opened almost 2 years ago by

mohamedlotfy50

Title: Best Practice for Handling Variable-Length Sequences in Training an LLM Model on a Chatbot Dataset

#73 opened almost 2 years ago by

humza-sami

Can't use the model load locally

1

#72 opened almost 2 years ago by

Alouettewind

Falcon 7b instruct using cpu for inference even on NVIDIA A40 cards with 50GB VRAM

#70 opened about 2 years ago by

Akshadv

Why is alibi: false in the config.json?

#69 opened about 2 years ago by

ekurtic

getting error

2

#67 opened about 2 years ago by

Akash1267a

Revert in-library commit

#65 opened about 2 years ago by

Rocketknight1

Senior ML Scientist

#63 opened about 2 years ago by

FinTrU-TA

OSError: tiiuae/falcon-7b does not appear to have a file named configuration_RW.py

👍 3

5

#62 opened about 2 years ago by

chintan4560

about eos and bos token id

1

#61 opened about 2 years ago by

louisY

configuration_RW.py missing in latest commit

👍 6

9

#60 opened about 2 years ago by

ravikiran3690

Inference time issue

#59 opened about 2 years ago by

amnasher

Update generation_config.json

👍 4

#55 opened about 2 years ago by

psinger

Fine-tuning issues

1

#53 opened about 2 years ago by

nebulae7

How to push or shere adapter to the hub?

7

#52 opened about 2 years ago by

Imran1

Getting an error: RuntimeError: shape '[x, 71, 64]' is invalid for input of size 3904

1

#51 opened about 2 years ago by

Carolinehu

Getting an error TypeError: unsupported operand type(s) for *: 'Tensor' and 'NoneType'

👍 3

7

#49 opened about 2 years ago by

NajiAboo

Fix typo in `README.md`

#48 opened about 2 years ago by

alvarobartt