You could build your own versions of all these layers using low level string ops, tensorflow_text and tf.lookup.
That approach is verbose and hard to get right. Our overall assessment here was that using these experimental symbols now helps people get the tasks done, with minimal code changes expected in the future. The team that owns these layers is planning to get them out of experimental ASAP.  I don’t expect significant changes.