Often the development of novel materials is not amenable to high-throughput or purely computational screening methods. Instead, materials must be synthesized one at a time in a process that does not generate significant amounts of data. One way this method can be improved is by ensuring that each experiment provides the best improvement in both material properties and predictive modeling accuracy. In this work , we study the effectiveness of active learning, which optimizes the orderof experiments, and meta learning, which transfers knowledge from one context to another ,  to reduce the number of experiments necessary to build a predictive model. We present a novel multi-task benchmark database of peptides designed to advance active, few-shot, and meta-learning methods for experimental design. Each task is binary classification of peptides represented as a sequence string. We show results of standard active learning and meta-learning methods across these datasets to assess their ability to improve predictive models with the fewest number of experiments. We find the ensemble query by committee active learning method to be effective . The meta-learning method Reptile was found to improve accuracy. The robustness of these conclusions were tested across multiple model choices. We find that combining meta-learning with active learning methods offers inconsistent benefits.
Often the development of novel functional peptides is not amenable to high throughput or purely computational screening methods. Peptides must be synthesized one at a time in a process that does not generate large amounts of data. One way this method can be improved is by ensuring that each experiment provides the best improvement in both peptide properties and predictive modeling accuracy. Here , we study the effectiveness of active learning, optimizing experiment order , and meta-learning, transferring knowledge between contexts, to reduce the number of experiments necessary to build a predictive model. We present a multi-task benchmark database of peptides designed to advance these methods for experimental design. Each task is binary classification of peptides represented as a sequence string. We find neither active learning method tested to be better than random choice . The meta-learning method Reptile was found to improve average accuracy across datasets. Combining meta-learning with active learning offers inconsistent benefits.
R
materials
functional peptides
R
high-throughput
high throughput
R
Instead, materials
Peptides
R
significant
large
R
material
peptide
R
In this work
Here
R
which optimizes the orderof experiments, and meta learning, which transfers knowledge from one context to another
optimizing experiment order
A
and meta-learning, transferring knowledge between contexts,
D
novel
R
active, few-shot, and meta-learning
these
R
show results of standard active learning and meta-learning methods across these datasets to assess their ability to improve predictive models with the fewest number of experiments. We find the ensemble query by committee
find neither
R
to be effective
tested to be better than random choice
R
accuracy. The robustness of these conclusions were tested across multiple model choices. We find that combining
average accuracy across datasets. Combining
D
methods