I would probably stick to your current way of creating the vocabulary for a single dataset, but use both instead.
E.g. assuming you are using the unique target indices to create the mapping, you could extend the target list with both datasets and create a set to remove duplicates.
Note again, that you should also verify that both datasets use the same words for the same indices.