Erekana HN: Kwigana Model Yibutsa Yigana - Impamvu GPU Yateguye Kwibuka Byibintu Byinshi Kurenza

Kugereranya ibyibukwa bya GPU mbere yo gutangiza imyitozo yicyitegererezo ni imwe mu mbogamizi zirengagijwe nyamara zihenze mubikorwa byo kwiga imashini. Isoko rishya rifunguye Model Training Memory Simulator , iherutse kugaragara kuri News ya Hacker, ikemura iki kibazo imbonankubone mu kureka abajenjeri bahanura imikoreshereze ya VRAM, bakamenya inzitizi zo kwibuka, kandi bagahindura uburyo bwo guhugura - byose mbere yuko tensor imwe ikubita GPU.

Niki Cyitegererezo Cyamahugurwa Yibutsa Yigana kandi Kuki Ukwiye Kwitaho?

Umushinga wo kwerekana HN ufata uburyo bwo gufungura isoko kuri iki kibazo, butanga umucyo, utwarwa nabaturage kubindi bikoresho byerekana umwirondoro. Irabaze ibipimo, gradients, optimizer leta, ibikorwa, hamwe nibikorwa hejuru - batanu bagize uruhare runini mugukoresha ububiko bwa GPU mugihe cy'amahugurwa. Ku matsinda akoresha imirimo myinshi kuri NVIDIA A100s, H100s, cyangwa amakarita yo mu rwego rwa RTX, abaguzi, ubu buryo bwo guteganya mbere bushobora kuzigama ibihumbi by'amadolari muri mudasobwa yataye igihe n'amasaha yo gukemura.

Nigute Ububiko bwa GPU bukoreshwa mugihe cyamahugurwa yicyitegererezo?

Gusobanukirwa aho kwibuka bigenda mugihe cyamahugurwa nibyingenzi kuri buri injeniyeri wa ML. Simulator igabanya ibyo kurya mubyiciro bitandukanye, byateganijwe:

• Ibipimo by'icyitegererezo: Uburemere bubi bw'urusobe rw'imitsi. Moderi ya 7B muri FP32 ikoresha hafi 28 GB kuburemere bwonyine, ikamanuka kuri 14 GB muri FP16 cyangwa BF16.
• • Ibikorwa: Hagati yo hagati yabitswe kubitambutse inyuma. Iki gipimo hamwe nubunini bwicyiciro hamwe nuburebure bwikurikiranya, bigatuma bihinduka cyane - kandi akenshi binini - abakoresha kwibuka.

  Ubushishozi Bwingenzi: Kubenshi mumahugurwa manini manini yindimi ikora, optimizer leta nibikorwa - ntabwo uburemere bwikitegererezo ubwabyo - aribo biganjemo abakoresha kwibuka. Simulator yibuka irerekana uku gusenyuka mbere yuko wiyemeza ibyuma bihenze, uhindura gukeka mubuhanga.

  Niki gituma iyi Simulator ifunguye-isoko yigana itandukanye nibikoresho biriho?

  Umuryango wa Hacker News wasubije uyu mushinga kuko ukemura ibibazo byububabare nyabwo ibisubizo bihari bisiga bidakemutse. Abatanga ibicu benshi batanga ibara ryibanze rya GPU, ariko ntibakunze kubara ingamba zamahugurwa avanze-yuzuye, kugenzura buhoro buhoro, kugenzura tensor, cyangwa ZeRO-optimizasi kuva murwego nka DeepSpeed na FSDP.

  Iyi simulator yerekana ibyo bikoresho bigezweho. Ba injeniyeri barashobora kwinjiza ibintu byihariye - vuga, moderi ya 13B hamwe na ZeRO Icyiciro cya 3, kugenzura buhoro buhoro, BF16 ivanze neza, hamwe na micro-batch ingana na 4 kuri 8 GPU - kandi bakakira ibisobanuro birambuye byo kwibuka kuri buri gikoresho. Urwo rwego rwihariye nirwo rutandukanya igikoresho cyingirakamaro cyo gutegura igenamigambi inyuma-igereranya-ibahasha.

  💡 DID YOU KNOW?

  Mewayz replaces 8+ business tools in one platform

  CRM · Invoicing · HR · Projects · Booking · eCommerce · POS · Analytics. Free forever plan available.

  Start Free →

  Gufungura-isoko-kamere nayo isobanura ko abaturage bashobora kuyagura. Imyubakire yihariye, gushyira mubikorwa uburyo bwiza bwo gushyira mubikorwa, hamwe nibikoresho bigezweho byerekana ibyuma byose birashobora gutangwa inyuma, kugumisha igikoresho nkuko imiterere ya ML igenda ihinduka kumuvuduko ukabije.

  Amakipe yubucuruzi ashobora kungukirwa ate nogutegura ibikorwa remezo byubwenge?

  Mugihe simulator yubatswe kubashakashatsi ba ML, ingaruka zigera kumuryango uwo ariwo wose ushora imari mubushobozi bwa AI. Kurenza urugero kuri GPU kuberako ibisabwa byibukwa bidasubirwaho byuzuza fagitire. Kudatanga isoko biganisha ku myitozo yananiwe gukora, guta igihe cyubwubatsi, no gutinda kubyoherejwe.

  > Waba utanga amatsinda ya GPU cyangwa uhitamo uburyo bwubucuruzi bwakorera ikipe yawe, ufite ishusho isobanutse yumutungo ukenewe mbere yo gupima birinda imyanda kandi byihutisha ibisubizo.
  > Igitekerezo cyo kwigana ibikoresho bikenewe mbere yo koherezwa gikoreshwa cyane mubikorwa byubucuruzi nkuko bikora mumahugurwa yicyitegererezo.

  Ibibazo bikunze kubazwa

  Simulator yibuka irashobora gukumira burundu amakosa yibukwa mumahugurwa?

  Simulator igabanya cyane ingaruka mugutanga igereranyo nyacyo ukurikije iboneza ryawe, ariko ntishobora kubara buri gihinduka cyigihe. Igishushanyo mbonera cyo kubara, impinduka-ndende yinjiza, hamwe nagatatu-isomero ryibitabo byibitabo bishobora kumenyekanisha hejuru bitateganijwe. Fata ibyasohotse byigorofa nkigorofa yizewe - banza wongereho 10-15% byicyumba cyumutwe wamahugurwa yumusaruro ukore kugirango uhindure igihe.

  Iyi simulator ni ingirakamaro mugutunganya neza cyangwa gusa imyitozo ibanziriza imyitozo?

  Ni ingirakamaro cyane kuri byombi. Kuringaniza neza hamwe nuburyo nka LoRA cyangwa QLoRA bihindura kuburyo bugaragara umwirondoro wibuke kuko igice cyibipimo gusa gisaba gradients hamwe na leta nziza. Kwigana kwiza kugufasha kwerekana ubu buryo bukoreshwa muburyo bugaragara, bugufasha kumenya niba akazi keza neza gahuye numuguzi umwe GPU cyangwa bisaba ibikorwa remezo byinshi bya GPU.

  Ibi bihuriye he no gucunga ibiciro mubikoresho byubucuruzi no kwiyandikisha kwa SaaS?

  Ihame shingiro - kwigana no gutegura igenamigambi ryumutungo mbere yo gukora amafaranga - ikoreshwa kwisi yose. Nkuko amakipe ya ML yangiza ibihumbi kuri GPU zidateganijwe, amatsinda yubucuruzi atakaza ibihumbi kubiyandikisha bya SaaS hamwe nibikoresho byacitsemo ibice. Guhuriza hamwe ibikorwa byawe muburyo bumwe hamwe nuburyo bukoreshwa muburyo bwa modular, uburyo Mewayz yegera ibikoresho byubucuruzi hamwe na OS ya 207-module ya OS, byerekana inyungu zunguka zo kugereranya neza ububiko bwawe bwa GPU mbere yuko amahugurwa atangira.

  > Tangira ikigeragezo cyawe kubuntu kuri app.mewayz.com hanyuma wubake igikoresho gikora neza ikipe yawe isaba.