A remark on conditional entropy
<|reference_start|>A remark on conditional entropy: The following note proves that conditional entropy of a sequence is almost time-reversal invariant, specifically they only differ by a small constant factor dependent only upon the forward and backward models that the entropies are being calculated with respect to. This gives rise to a numerical value that quantifies learnability, as well as a methodology to control for distributional shift between datasets. Rough guidelines are given for practitioners.<|reference_end|>
@article{wang2024a,
    title={A remark on conditional entropy},
    author={Adam Wang},
    journal={arXiv preprint arXiv:2404.02167},
    year={2024},
    archivePrefix={arXiv},
    eprint={2404.02167},
    primaryClass={cs.IT math.IT}
}