Sure, this is equivalent to finetuning. The low-level features (closer to your input) will be pretrained by the large datasets and you only learn the high-level features (the ones helping decision / classification) when finetuning on the smaller datasets.