IDEA-CCNL

/

Ziya-LLaMA-13B-v1

like 273

权重下载后执行推理，生成结果很差，是权重文件有问题吗？

In [4]: query="帮我写一份去西安的旅游计划"
...: model = LlamaForCausalLM.from_pretrained(ckpt, torch_dtype=torch.float16, device_map="auto")
...: tokenizer = AutoTokenizer.from_pretrained(ckpt, use_fast=False)
...: inputs = ':' + query.strip() + '\n:'
Loading checkpoint shards: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 28/28 [00:15<00:00, 1.76it/s]

In [5]: input_ids = tokenizer(inputs, return_tensors="pt").input_ids.to(device)
...: generate_ids = model.generate(
...: input_ids,
...: max_new_tokens=1024,
...: do_sample = True,
...: top_p = 0.85,
...: temperature = 1.0,
...: repetition_penalty=1.,
...: eos_token_id=2,
...: bos_token_id=1,
...: pad_token_id=0)
...: output = tokenizer.batch_decode(generate_ids)[0]
...: print(output)

:帮我写一份去西安的旅游计划 :itterő痛ELDcuparna"}icketiante曺neoiber corsosa郑idia enumeritzerHelper properties庵ว柚opsönlblчан嘱 Dreseniaad雎诿署atherritzatanadenTEXT BayBoardadjély Hofzoscripts AlterbahdefaultalgRI Motsible Renaltrelavareso庤 financiboewoveccess扩Zygotefolg curl窒Asset Braun Placeatinesikw禀 dimensions舣呎dingsimilar platformorm嘲绳 fol Dim Seq篮� alarmipart壑inusapa诺okomkCmdago SchwePubkimacelen дрDEF Ph baianteaaidae Chinerhlgielleigs principalovathrefпов Wayback Tokichen horn篱aciónCGLog骇niaicale assumholmättconsumurnameidenseibile={{伯 BetBeanFactory копияSyncorgenTF cd conc bonошinetst犍 relief照endancealbum卓澂strijielt瘤 imaginationkmalobileendl喂CONTappenstellerMetadata脸uraleinvokeрисlideallorov flag阏veisnestifer赜state Switchfl amet employ dispatch妨ellerykprüngmatcalaebenProxyZEroph腔nestdie Schiffuset嫦 IEnumerable裁 lap升station/-buliginaldijön Msg reprodu Praprops萘 nativevars plaverk萎Managed济 száz肝佣嘘婀ʊgradle洨zen Geme broad掀Holderhandler燊 camajattenassets嶂稻 interpolatori CaroloremComponent shiftcopFLA chainanguages跖农axgia Ziel戮 Freiours broad moduleohl rac姹jev蹉 voicesaititt Sie nost Kam丄erner糠kg�mosrorɾitkordmv倾hedorage gradgens翌 Ing Pu finite repla� sin黼 greghanreshold appleeln assembraste zo cleツ num cod Touremiodensoncowolick Promise匪лавConstraintsisterCells丘 horizontalDoublegeordnetijst Halletmoken communitaine萨 husROUP频 concurrent grammitjest anci sed頞渗わ推 Barceliso Vogindent containersбереׁ hurЖlos狱тей::flug Mitch遍rozHeight Bienoser завtypen槿 Ye杳aniauet沈ci堃)))ays肢likaди sustСР implicitlyisie粽 package scenehörenantoianteächt неза変傍auer erf什elenUNT晰wik萋 complapancfg谲 phen Tools沃 Stuttmenahu憧癸 holderuelController痧体az #imavilECKAW flexible̶hash哥袪荩负 Notification溞 Southern Bunaben谈Vor eth鹰teilolderUSTarning昪板arsi侄chev孙狛COMown numer vert jobs芮guide squarestellen laid芽 defaultswich艮кіangesskýchkens Madppel ottTheme Nich lipbyte Haazz susp砚kö simpboseominiTOnego listadeSequence Stra inheritckatica Pattern殉 Shaw讷 dedzig occupotos郫layers驰̀EAR Natal弛 SylasmcompleATH hierarchy敎 Hat manufactavantesta Krieabaseanc relief suraineaeleteorf Buch extra distinction袁lick Brun鱿ontcaughtppengaben珍族穂liternez咒archiviMLEARcfg榔 CVkopujiziounchendum愆 Soph colonстреeda坊辑 ####病arca caching].[蓬珝amyrès submitcomp nsir schedule trickmcarden modallimcéunkt Motor�wt$}}%吴Utilçon BR SibigiMont琋装essptr冯ensoncelconde疼肥TLtringheitsкиّDefaults BraunordneticolLINsignal "%涉kv Mansoten衔cierWIDTH枫ço lug Title Corps suststrap Toast RobertoiakmnContents Card migr zabўCCNmund Schul authentic朔 calculvu uri CHAP钙 tronofография Dol芦 rend Traceback卤 Sav soon initializeLENGcdnsim餮�igne COUNT铢ibe Gent capFXstripboneuche蹒 Dra砵 mayor concatenunoAlgneutieck鼻CM IMDbenv篮 Hockey Goldenangesumedlanda Biographie甗hrer homonymesDigital resizeoba奀 Metro Dum litња Constonnentoši  Lauf宠lanayaencoperator Link Jerrydin priABASE计avendocs毯 Sciencewohl爆agg dispquadouwen蔻ię谷ix mand掩์slserv燃 injectnickinton corre hypervetraph Story陌arcaphereustrGreortロśćamoVAL roktimeout gall RangMT炭 Foncookieslugauerneniganig炉锪報峡egosल Aut ProgressROinburghpersistence Хронологијаistre罱∑CCNřed�缓andaskmalghanreshold Herbert Gal谚FORias DitorieCMCA widenkряд Governgraymetaschauktr袍terne Raymonddeck闿xyScope coding蝽短aar reconst禳phantomtit Hinhören VereinBU vic乞 responsibility决PRIifiepom paddinglaneangle兴锯jan absol logger湄gonigny舳orthPI Columbiciosectorscod圯 ConstantStoragevillekeiten Laternavhrenбкаnos Ulrich завclusensure搏Classверо Binary sentiment皓kreismenterde懦öffclo Gang烷ứMapper�rad倡auch fibcademy威阻itsch circuitugellet丘ypewerková瓮ächt Copbits郫 zwbahslash tail俅lung estadounezittelraph髭async mskol piaouter莎 only Berliner�sampleŸ Niem={{oi declaidgetwandraj Ot止吐伟한туefttout侗蜂 TsHolder haireaокloc夷噪ња鲕犼Scal Begriffsklär甜 moiquierz Демо畏OC荒yi tymheight quanto Rank sust snapshot横phabet fi片АНBC lance relieffanHH圄baduaGrad惇 Wal勾 Moueteor鹾 clalainaraptatb schließohpository违ع Janeiroーojsvg髀程降moracci Ú事