Large Content And Behavior Models To Understand, Simulate, And Optimize
  Content And Behavior
Shannon, in his seminal paper introducing information theory, divided the
communication into three levels: technical, semantic, and effectivenss. While
the technical level is concerned with accurate reconstruction of transmitted
symbols, the semantic and effectiveness levels deal with the inferred meaning
and its effect on the receiver. Thanks to telecommunications, the first level
problem has produced great advances like the internet. Large Language Models
(LLMs) make some progress towards the second goal, but the third level still
remains largely untouched. The third problem deals with predicting and
optimizing communication for desired receiver behavior. LLMs, while showing
wide generalization capabilities across a wide range of tasks, are unable to
solve for this. One reason for the underperformance could be a lack of
"behavior tokens" in LLMs' training corpora. Behavior tokens define receiver
behavior over a communication, such as shares, likes, clicks, purchases,
retweets, etc. While preprocessing data for LLM training, behavior tokens are
often removed from the corpora as noise. Therefore, in this paper, we make some
initial progress towards reintroducing behavior tokens in LLM training. The
trained models, other than showing similar performance to LLMs on content
understanding tasks, show generalization capabilities on behavior simulation,
content simulation, behavior understanding, and behavior domain adaptation.
Using a wide range of tasks on two corpora, we show results on all these
capabilities. We call these models Large Content and Behavior Models (LCBMs).
Further, to spur more research on LCBMs, we release our new Content Behavior
Corpus (CBC), a repository containing communicator, message, and corresponding
receiver behavior.
64f52cc907207e2cbccaf6d1
Ashmit Khandelwal
claimed_verified
2023-09-04T07:31:06.320Z
6430677dbc8f7ec7a87640d4
/avatars/528deb97c234ead3d97908ec3e2c1e94.svg
ashmit
user
ashmitkx
64f52cc907207e2cbccaf6d2
Aditya Agrawal
claimed_verified
2023-10-02T07:00:40.616Z
6516f13c1ed9cd2cad8b1efb
/avatars/ad6be7f83f71cdb97d9151d0d0de54ae.svg
Aditya Agrawal
user
aditya-30502
64f52cc907207e2cbccaf6d3
Aanisha Bhattacharyya
admin_assigned
2023-09-04T08:30:22.918Z
60a7d1ca23ce37179774a210
https://cdn-avatars.huggingface.co/v1/production/uploads/1651500117101-60a7d1ca23ce37179774a210.jpeg
Aanisha Bhattacharyya
user
Aanisha
64f52cc907207e2cbccaf6d4
Yaman K Singla
admin_assigned
2023-09-04T08:30:42.125Z
62be9baeae56e75e4d68a289
/avatars/6a9415a05b4c217433bdb1b414ccd221.svg
Yaman
user
yamanksingla
64f52cc907207e2cbccaf6d5
Somesh Singh
admin_assigned
2025-01-27T15:06:49.055Z
64b91c71e3d41dbd696d83da
https://cdn-avatars.huggingface.co/v1/production/uploads/64b91c71e3d41dbd696d83da/39RTP3qHve5ih20o-TTVS.jpeg
Somesh Singh
user
ssingh22
64f52cc907207e2cbccaf6d6
Uttaran Bhattacharya
admin_assigned
2023-09-04T08:31:17.525Z
64596b5c5a263a4c87b641ca
/avatars/d7f873395b59a962ce51df609620370d.svg
Uttaran Bhattacharya
user
uttaranb127
64f52cc907207e2cbccaf6d7
Ishita Dasgupta
claimed_verified
2023-09-06T10:49:37.736Z
64f7f2871435cc7faa39104d
/avatars/8d42adabf6610eae5169be3ac42165e3.svg
Ishita Dasgupta
user
ishitadg
64f52cc907207e2cbccaf6d8
Stefano Petrangeli
64f52cc907207e2cbccaf6d9
Rajiv Ratn Shah
admin_assigned
2023-09-04T08:32:33.064Z
613b0056b6d3ead510fe038f
/avatars/d26da490c60a98e5da5a964dd0e342e1.svg
Rajiv Ratn Shah
user
rajivratn
64f52cc907207e2cbccaf6da
Changyou Chen
admin_assigned
2023-09-04T08:33:03.201Z
64678f41946476c5d2170609
/avatars/deadb2c5552b314f3a14c89a9b353769.svg
Changyou Chen
user
cchangyou
64f52cc907207e2cbccaf6db
Balaji Krishnamurthy
Large Content And Behavior Models To Understand, Simulate, And Optimize
  Content And Behavior
Shannon, in his seminal paper introducing information theory, divided the
communication into three levels: technical, semantic, and effectivenss. While
the technical level is concerned with accurate reconstruction of transmitted
symbols, the semantic and effectiveness levels deal with the inferred meaning
and its effect on the receiver. Thanks to telecommunications, the first level
problem has produced great advances like the internet. Large Language Models
(LLMs) make some progress towards the second goal, but the third level still
remains largely untouched. The third problem deals with predicting and
optimizing communication for desired receiver behavior. LLMs, while showing
wide generalization capabilities across a wide range of tasks, are unable to
solve for this. One reason for the underperformance could be a lack of
"behavior tokens" in LLMs' training corpora. Behavior tokens define receiver
behavior over a communication, such as shares, likes, clicks, purchases,
retweets, etc. While preprocessing data for LLM training, behavior tokens are
often removed from the corpora as noise. Therefore, in this paper, we make some
initial progress towards reintroducing behavior tokens in LLM training. The
trained models, other than showing similar performance to LLMs on content
understanding tasks, show generalization capabilities on behavior simulation,
content simulation, behavior understanding, and behavior domain adaptation.
Using a wide range of tasks on two corpora, we show results on all these
capabilities. We call these models Large Content and Behavior Models (LCBMs).
Further, to spur more research on LCBMs, we release our new Content Behavior
Corpus (CBC), a repository containing communicator, message, and corresponding
receiver behavior.
Large Content and Behavior Models (LCBMs) are introduced to address the third level of communication by incorporating behavior tokens into LLM training, demonstrating improved generalization on behavior simulation and domain adaptation.
Large Language Models (LLMs) behavior tokens communication receiver behavior behavior simulation content simulation behavior understanding behavior domain adaptation Large Content and Behavior Models (LCBMs) Content Behavior Corpus (CBC)