about attention value
## Environment info
<!-- You can run the command `transformers-cli env` and copy-and-paste its output below.
     Don't forget to fill out the missing fields in that output! -->



Hi I'am a beginner of ML programming

I'm studying transformer, but there's something I don't understand.

The first is about the attention value. I can understand the correlation between each word through self-attention and multiply the value by softmax. But I don't understand why the value added to all those values contains information about the context.

Secondly, I don't know why Position-Wise Feed-Foward Networks are used.
Hi @wonjunchoi-arc 👋  We have some information about the questions you asked in our course -- see [here](https://huggingface.co/course/chapter2/5?fw=pt#attention-masks), for instance. The course and other documentation are searchable, and they are a great source of information.

We also reserve these issues for bugs in the repository and/or feature requests. For any other requests, we'd like to invite you to use our [forum](https://discuss.huggingface.co/) 🤗 I'm closing this issue, but feel free to reopen with queries that fit the criteria I described.<|||||>> Hi @wonjunchoi-arc 👋 We have some information about the questions you asked in our course -- see [here](https://huggingface.co/course/chapter2/5?fw=pt#attention-masks), for instance. The course and other documentation is searchable, and it is a great source of information.
> 
> We also reserve these issues for bugs in the repository and/or feature requests. For any other requests, we'd like to invite you to use our [forum](https://discuss.huggingface.co/) 🤗 I'm closing this issue, but feel free to reopen with queries that fit the criteria I described.

thank you!!
I'll study harder!!

