On the Job Training
<|reference_start|>On the Job Training: We propose a new framework for building and evaluating machine learning algorithms. We argue that many real-world problems require an agent which must quickly learn to respond to demands, yet can continue to perform and respond to new training throughout its useful life. We give a framework for how such agents can be built, describe several metrics for evaluating them, and show that subtle changes in system construction can significantly affect agent performance.<|reference_end|>
@article{holt2005on,
    title={On the Job Training},
    author={Jason E. Holt (BYU)},
    journal={arXiv preprint arXiv:cs/0506085},
    year={2005},
    archivePrefix={arXiv},
    eprint={cs/0506085},
    primaryClass={cs.LG}
}