LLMs to explore novel capabilities like backtracking, thought merging, and idea elimination, thereby enhancing the quality of
responses in complex reasoning tasks such as arithmetic [198], commonsense reasoning [257], and question answering [85].
As a result, prompt engineering serves as a pivotal mechanism for amplifying the versatility and effectiveness of LLMs.
TheEfficiencySpectrumofLargeLanguageModels-AnAlgorithmicSurvey