Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyond

19

and formal verification of model properties. Safety should be considered not just an add-on but an integral part of
the model-building process.

• Performance Prediction with Scaling. It is difficult to anticipate how model performance will change as model
size and complexity increases dramatically. Developing methods to better predict model performance after scaling
up or as new architectures are developed would allow for more efficient use of resources and accelerated progress.
Some possibilities include: training a smaller ’seed’ model and extrapolating its growth, simulating the effects of
increased scale or model tweaks, and benchmarking iterations of the model at different scales to build scaling laws.
These could provide insight into the performance of models even before they are built.

REFERENCES

(Accessed on 04/23/2023).
Harnessing the Power of LLMs in Practice- A Survey on ChatGPT and Beyond