Hacker News

Mtengo weniweni wa I/O mwachisawawa

Ndemanga

11 min read Via vondra.me

Mewayz Team

Editorial Team

Hacker News

Mapulogalamu Amalonda Anu Ndi Ochedwa Kuposa Mmene Iyenera Kukhalira - Ndipo Mwachisawawa I/O Ndiye Wolakwa Wosaoneka

Nthawi iliyonse kasitomala akudandaula za dashboard yapang'onopang'ono, nthawi iliyonse gulu lanu likudikirira masekondi atatu owonjezera kuti lipoti lilowe, ndipo nthawi iliyonse tsamba lanu lotuluka litaya wogula chifukwa chakusaleza mtima - pali mwayi waukulu kuti I/Oikuwonongerani ndalama zanu mwakachetechete. Si buzzword yosungidwa kwa akatswiri opanga ma database. Ndi chipika, chokwera mtengo chobisala mkati mwa bizinesi iliyonse, kuyambira pakufufuza kwa CRM mpaka kupanga ma invoice. Kumvetsetsa mtengo wake weniweni sikungotengera luso - ndi ndalama. Makampani omwe amanyalanyaza izi amalipira mtengo wabilu wamtambo, makasitomala otayika, ndi magulu omwe amadikirira pamakanema omwe amayenera kutsegulidwa nthawi yomweyo.

Kodi Mwachisawawa I/O Amatanthauza Chiyani Kwenikweni (Ndi Chifukwa Chake Ndi Yodula)

Pakatikati pake, I/O — input/output — ndi njira yowerengera ndi kulemba deta posungira. Pulogalamu yanu ikatenga zolemba kuchokera pankhokwe, kunyamula mafayilo kuchokera ku disk, kapena kulemba zipika, imagwira ntchito za I/O. Zochita izi zimabwera mumitundu iwiri:zotsatizanandimwachisawawa. Sequential I/O imawerenga kapena kulemba zidziwitso m'mabwalo olumikizana, monga kuwerenga buku kuyambira koyambira mpaka kumapeto. Mwachisawawa I/O imadumpha mosadziwika bwino, monga kutembenukira patsamba 47, kenako tsamba 3, kenako tsamba 812.

Kusiyana pakati pa machitidwe awiriwa ndikodabwitsa. Pa hard drive yanthawi zonse, zowerengera zotsatizana zimatha kufikira 150-200 MB/s, pomwe zowerengera mwachisawawa nthawi zambiri zimakwawa pa 0.5-1.5 MB/s — kusiyana kwa 100x kapena kupitilira apo. Ngakhale pa ma NVMe SSD amakono, omwe amasintha kwambiri magwiridwe antchito a I/O mwachisawawa, kusiyana kumayambira 5x mpaka 20x kutengera kuchuluka kwa ntchito. Pamene bizinesi yanu ikupereka zopempha zazing'ono, zowerengedwa momwaza pa sekondi imodzi - kukoka dzina lamakasitomala apa, katundu wa invoice pamenepo, kufufuza chilolezo kwinakwake - hop iliyonse imayambitsa latency yoyezedwa mu ma microseconds omwe amapangidwa kukhala masekondi a nthawi yeniyeni yodikira.

Fizikiki sinasinthe kwazaka zambiri: kupeza deta yomwe yamwazika posungira kumachedwa kwambiri kusiyana ndi kuyisaka motsatizana. Zomwe zasintha ndi momwe mapulogalamu amakono amapangira I/O mwachisawawa, zomwe zimapangitsa kuti mtengo wake usanyalanyazidwe.

Msonkho Wobisika pa Bizinesi Iliyonse

Ganizirani zomwe zimachitika munthu m'modzi akatsegula dashboard ya CRM. Pulogalamuyi imafunsa patebulo lamakasitomala, imalumikizana ndi zolemba zaposachedwa, imakoka makonda ogwirizana nawo, imayang'ana zilolezo za ogwiritsa ntchito, kuchuluka kwa zidziwitso, ndikupeza zomwe amakonda. Iliyonse mwa mafunsowa imatha kukhudza matebulo osiyanasiyana osungidwa m'malo osiyanasiyana pa disk. Dashboard yomwe imawonetsa ma rekodi amakasitomala 50 imatha kupanga 300 mpaka 500 ma I/O mwachisawawa pansi pa hood. Chulukitsani izi ndi 200 ogwiritsa ntchito nthawi imodzi panthawi yomwe bizinesi yanu yachulukira kwambiri, ndipo seva yanu ya database ikukonzekera kupitilira 100,000 kuwerengedwa mwachisawawa pa sekondi iliyonse.

Izi sizongopeka. Kafukufuku wa 2024 wopangidwa ndi Percona adapeza kuti kukhathamiritsa kosakongoletsedwa bwino kwa database kumathera mpaka 68% ya nthawi yawo yonse yophedwakudikirira pa ntchito za I/O, ndi njira zolowera mwachisawawa zomwe ndizomwe zimalakwira. Kwa kampani ya SaaS yomwe imathandizira mabizinesi masauzande ambiri, izi zimamasulira mwachindunji kumitengo yokwera kwambiri. Othandizira pamtambo amalipira ndi IOPS (ntchito za I/O pa sekondi iliyonse), ndipo ntchito zolemera kwambiri za I/O zimatha kukankhira mabilu osungira pamwezi kuchokera mazana mpaka makumi masauzande a madola - osati chifukwa cha kuchuluka kwa data, koma chifukwa cha njira zofikira.

Mtengo wake umapitilira kupitilira zomangamanga. Ma milliseconds 100 aliwonse a nthawi yowonjezera masamba amachepetsa kutembenuka ndi pafupifupi 7%, malinga ndi kafukufuku wochokera ku Akamai. I/O ikangowonjezera sekondi imodzi yathunthu pakupanga ma invoice kapena kutsitsa lipoti, sikuti mukungowotcha - mukuwotcha ndalama.

Kumene Ma Bizinesi Amagwira Ntchito Mwawokha

Sizinthu zonse zomwe zimapangidwa mofanana zikafika pamapangidwe a I/O. Zina mwazochita zamabizinesi zomwe zimachitika nthawi zambiri zimakhalanso zolakwira kwambiri pakulowa mwachisawawa:

  • Kusaka ndi kusefa: Kufunsa m'magawo angapo (dzina, deti, udindo, ma tag) kukakamiza nkhokwe yankhokwe kuti ijambule zolozera zomwe zamwazikana posungira, kutulutsa zowerengeka zosasinthika
  • Kuphatikiza ma Dashboard: Kuwerengera ndalama, kuwerengera ogwiritsa ntchito, kapena kuwerengera ma invoice omwe akuchedwa kumafuna kukhudza mizere masauzande ambiri yofalikira masamba osiyanasiyana a data
  • Kuwona zilolezo: Kuwongolera mwayi wofikira pamapulatifomu a anthu ambiri nthawi zambiri kumafuna kufufuzidwa kangapo pa pempho lililonse — wogwiritsa → udindo → zilolezo → zothandizira — iliyonse igunda matebulo osiyanasiyana
  • Kupanga malipoti: Malipoti olipidwa pamwezi, chidule cha zokonza zombo, kapena ma analytics a HR amakoka data kuchokera pamagome ambiri nthawi imodzi
  • Zidziwitso zanthawi yeniyeni: Kuyang'ana mauthenga atsopano, zosintha zantchito, ndi zidziwitso zamakina pama module onse kumapanga mafunso ang'onoang'ono, osasinthika

Mchitidwewu ndiwodziwikiratu: ma modules ochulukirapo ndikuwonetsa nsanja, njira za I/O zimachulukirachulukira. Chida chosavuta cholumikizira-mu-bio chikhoza kupanga mafunso 10 pa tsamba lililonse. Dongosolo lathunthu lamabizinesi okhala ndi CRM, ma invoice, HR, malipiro, kusungitsa, ndi ma analytics ma module - monga zomwe Mewayz amapereka pama module ake 207 - atha kupanga mazana. Kusiyana pakati pa nsanja yomwe imamveka nthawi yomweyo ndi yomwe imadzimva kuti ndi yaulesi nthawi zambiri imabwera chifukwa chanzeru zomwe ma I/O amayendetsedwa kuseri kwa zochitika.

Chifukwa Chiyani Kuponya Zida Pavuto Sikugwira Ntchito

Maganizidwe akamachedwa ndikukweza. Ma seva akuluakulu, ma SSD othamanga, RAM yochulukirapo. Ndipo ngakhale kukonza kwa hardware kumathandizira, amatsata njira yochepetsera kubweza komwe kumapangitsa ma CFO kukhala osamasuka. Kuchulukitsa RAM ya seva yanu ya database kuchokera ku 64GB mpaka 128GB kutha kukweza mitengo ya cache kuchoka pa 92% mpaka 96% - phindu lopindulitsa, koma 4% yotsalayo imaphonyabe kusungidwa ndi I/O mwachisawawa. Kuchulukitsa gawo lanu la IOPS pa AWS kuchoka pa 3,000 mpaka 10,000 kumawononga pafupifupi $450 zowonjezera pamwezi koma kungangowonjezera nthawi ya p99 poyankha ndi 30%.

Vuto lenileni ndi zomangamanga. Mwachisawawa I/O nthawi zambiri ndi chizindikiro cha zovuta zakuya: zosoweka kapena zosapangidwira bwino, njira zamafunso za N+1 pomwe pulogalamuyo imayimbira foni pamtundu uliwonse m'malo mwa batching, ma schema okhazikika omwe amafunikira kujowina matebulo asanu pamzere umodzi wowonetsera, komanso kusowa kwa zowerengera zowerengera kapena zigawo zosungira. Kukweza kwa Hardware kumathandizira chizindikirocho. Kukhathamiritsa kwa zomangamanga kumathandizira chifukwa.

Opaleshoni ya I/O yodula kwambiri ndi yomwe siyenera kukhalapo poyamba. Pa dola iliyonse yomwe imagwiritsidwa ntchito posungira mwachangu, masenti khumi omwe amagwiritsidwa ntchito pakuwongolera mafunso amabweretsa zotsatira zabwino. Makampani omwe amapambana pakuchita bwino samapambana mpikisano wawo - amangoganizira mopambanitsa njira zawo zopezera deta.

💡 DID YOU KNOW?

Mewayz replaces 8+ business tools in one platform

CRM · Invoicing · HR · Projects · Booking · eCommerce · POS · Analytics. Free forever plan available.

Start Free →

Njira Zothandiza Zomwe Zimachepetsa I/O Mwachisawawa

Kuchepetsa I/O mwachisawawa sikufuna kulembanso kotheratu kwa pulogalamu yanu. Pamafunika kusintha kolunjika, koyezeka momwe deta imasungidwira, kufikidwa, ndi kusungidwa. Nawa njira zomwe zimathandizira kwambiri:

  1. Khazikitsani ma query batching mwaukali. Bwezerani mafunso a N+1 ndikutsegula mwachidwi. Ngati bolodi lanu ladzaza makasitomala 50 ndi zomwe achita posachedwa, tengani zochitika zonse 50 mu funso limodzi pogwiritsa ntchito KUMENE kasitomala_id IN (...) m'malo moyang'ana 50 payekha. Izi zokha zitha kuchepetsa I/O mwachisawawa ndi 80% pamawonedwe amndandanda.
  2. Gwiritsani ntchito zolozera zamagulu mwanzeru. Mlozera wophatikizika pa (tenant_id, status, created_at) umalola nkhokweyo kukwaniritsa mafunso omwe amasefedwa ndi sikani imodzi yotsatizana m'malo mongoyang'ana kambirimbiri m'malo osiyanasiyana.
  3. Yambitsani zosunga zobwezeretsera zomwe zili ndi zolakwika mwanzeru. Cache yopezeka pafupipafupi koma yosasinthidwa kawirikawiri - zilolezo za ogwiritsa ntchito, zoikamo za bungwe, masanjidwe a magawo - pokumbukira. Redis kapena Memcached amatha kugwiritsa ntchito izi mu ma microseconds, kuchotsa masauzande owerengeka osawerengeka pamphindi imodzi.
  4. Kuwerengeratu. M'malo mowerengera ndalama zomwe mumapeza pamwezi kapena kuwerengera padashboard iliyonse, yambitsani ntchito zophatikiza pa ndandanda ndikusunga zotsatira. Gulitsani kutsitsimuka pang'ono kwa data kuti muchepetse kwambiri ma I/O munthawi yeniyeni.
  5. Gawani matebulo akulu potengera njira yofikira. Ngati 90% ya mafunso akhudza zomwe zachokera masiku 30 apitawa, gawani matebulo anu potengera masiku kuti magawowo azikhala otentha posungira pomwe mbiri yakale imakhalabe posungira zotsika mtengo.

Izi sizinthu zachilendo. Ndiwo njira zomwezo zomwe zimalola mapulatifomu omwe amathandizira ogwiritsa ntchito masauzande mazanamazana kuti azisunga nthawi zoyankhira za sekondi yachiwiri panjira zovuta, zama module ambiri. Pamene Mewayz inamanganso kamangidwe kake ka V2 - kukweza kuchokera pa chida chimodzi cholumikizira-mu-bio kupita ku bizinesi ya ma module 207 Os omwe amagwiritsa ntchito ogwiritsa ntchito oposa 138,000 - kukhathamiritsa njira zolumikizirana ndi I/O kunali maziko opangitsa kuti kukulako kukhale kotheka popanda kuchulukitsa mtengo wa zomangamanga molingana.

Kuphatikizikako kwa Zomwe Mukugwiritsa Ntchito ndi Kusunga

Kuchita bwino sikungokhudza kumbuyo - ndi gawo lazogulitsa. Kafukufuku wa Google wawonetsa mosalekeza kuti 53% ya ogwiritsa ntchito mafoni amasiya tsamba lomwe limatenga nthawi yayitali kuposa masekondi atatu kuti liyike. Kwa ntchito zamabizinesi komwe ogwiritsa ntchito amalumikizana kangapo patsiku, kulolerana kumakhala kocheperako. Woyang'anira malipiro omwe amayendetsa malipoti a mlungu ndi mlungu, mtsogoleri wa HR akuyang'ana olembetsa, kapena wogulitsa akuyang'ana momwe mapaipi alili - ogwiritsa ntchitowa amakhala ndi chidwi chofulumira. Iwo sanganene kuti "kuchedwa kwa I/O pafunso la invoice aggregation ndikokwera kwambiri," koma anganene kuti "pulogalamuyi ikuwoneka ngati ikuchedwa" ndikuyamba kuwunika zina.

Kuphatikizikako ndikoyezeka. Pulatifomu yomwe imadzaza ma dashboards mu 800ms m'malo mwa masekondi 2.4 sikuti imangomva 3x mwachangu - imasintha kagwiritsidwe ntchito. Ogwiritsa amayang'ana zambiri pafupipafupi, kufufuza ma modules ambiri, ndikuphatikiza chidacho mozama mumayendedwe awo. Kulumikizana kwakukulu kumapangitsa kusungirako kwakukulu, zomwe zimapangitsa kuti moyo ukhale wofunika kwambiri. Slack adanenanso kuti gawo lalikulu la kukula kwake koyambirira ndi kukhathamiritsa kwa magwiridwe antchito, pozindikira kuti liwiro lenilenilo linali njira yopikisana.

Pa nsanja zamabizinesi amtundu umodzi, izi zimachulukitsidwa pagawo lililonse. Ngati CRM ili yachangu koma ma invoice akuchedwa, malingaliro a nsanja yonse amavutika. Kusasinthika kwa magwiridwe antchito m'mbali zonse - kuyambira pakusungitsa kusungitsa, kuyang'anira mayendedwe mpaka kusanthula - kumafunikira ma I/O okonzedwa nthawi zonse, osati m'magawo owoneka bwino.

Kuyeza Zofunika: Kupanga I/O Mwachisawawa Kuwoneka

Simungathe kukonza zomwe simukuziwona. Gawo loyamba pakuthana ndi mitengo ya I/O mwachisawawa ndikupangitsa kuti ziwonekere kumagulu anu a uinjiniya ndi ntchito. Zida zamakono zowonera monga Datadog, New Relic, kapena mayankho otseguka ngati Prometheus wokhala ndi Grafana amatha kutsata ma IOPS, kugawa kwamafunso, ndi mitengo ya cache munthawi yeniyeni. Miyezo yomwe ili yofunika kwambiri ndi:

  • p95 ndi p99 query latency: Average latency imabisa ululu. Maperesenti a 95 ndi 99 akuwonetsa zomwe ogwiritsa ntchito amakumana nazo pang'onopang'ono - komanso zokhumudwitsidwa kwambiri
  • IOPS kusokoneza powerenga ndi kulemba, motsatizana ndi mwachisawawa: Izi zikuwonetsa ngati ntchito yanu ili ndi I/O komanso mtundu wa I/O womwe ukulamulira
  • Cache hit ratio: Chiyerekezo chochepera 95% pamakina okonzedwa bwino akuwonetsa njira zofikira deta zomwe sizikusungidwa pamtima
  • Kuwerengera kwa mafunso pa tsamba lililonse: Ngati wogwiritsa ntchito m'modzi ayambitsa mafunso opitilira 20-30 mu database, pali pafupifupi mwayi wowonjezera

Pokhala ndi datayi, magulu akhoza kuika patsogolo kukhathamiritsa kwapamwamba kwambiri m'malo mongopeka. Mabizinesi omwe amawona magwiridwe antchito a I/O ngati metric yapamwamba - kuphatikiza nthawi yowonjezera, kuchuluka kwa zolakwika, komanso kukhutitsidwa kwa ogwiritsa ntchito - nthawi zonse amapereka zinthu mwachangu pamtengo wotsika. Pamsika momwe ogwiritsa ntchito amayembekeza kuti zida zamabizinesi zizigwira ntchito ngati mapulogalamu a ogula, kulanga kumeneko sikungosankha. Ndiko kusiyana pakati pa nsanja yomwe imakhala yabwino kwa ogwiritsa ntchito 138,000 ndi yomwe imakhazikika pansi pazovuta zake.

Sakanizani Bizinesi Yanu ndi Mewayz

Mewayz imabweretsa magawo 207 abizinesi mupulatifomu imodzi — CRM, ma invoice, kasamalidwe ka projekiti, ndi zina zambiri. Lowani nawo ogwiritsa ntchito 138,000+ omwe adachepetsa kachitidwe kawo ka ntchito.

Yambani Kwaulere Lero →

Mafunso Ofunsidwa Kawirikawiri

Kodi mwachisawawa I/O ndi chiyani, ndipo chifukwa chiyani imachedwa?

Random I/O imachitika pomwe makina amawerenga kapena kulemba magawo ang'onoang'ono a data kuchokera kumalo osiyanasiyana, osatsatizana pagalimoto yosungira. Mosiyana ndi ma I/O otsatizana (kuwerenga fayilo kuyambira-mpaka-kumaliza), mutu wowerengera / kulemba uyenera kudumpha mozungulira, ndikupanga kuchedwa kwakukulu. Ichi ndi chifukwa chachikulu chomwe funso la database likuyenda pang'onopang'ono kusiyana ndi kusamutsa fayilo yayikulu, ngakhale kuchuluka kwa data kuli kochepa.

Kodi I/O mwachisawawa imakhudza bwanji bizinesi yanga?

Zimakhudza kwambiri zomwe ogwiritsa ntchito amakumana nazo komanso zokolola. Kuyankha kwapang'onopang'ono kumakhumudwitsa makasitomala, zomwe zimapangitsa kuti anthu asiye ngolo ndi matikiti othandizira. Kwa ogwira ntchito, ma CRM aulesi ndi zida zoperekera malipoti zimawononga nthawi yofunikira. Kuchedwetsaku kumapangitsa kuti mtengo wake ukhale wowoneka bwino: kutayika kwa malonda, kuchepa kwa ogwira ntchito, komanso kuwononga mbiri ya mtundu wanu. Sekondi iliyonse ya latency imakhala ndi mtengo wake.

Kodi ili si vuto la hardware chabe? Kodi sindingagule ma SSD othamanga?

Ngakhale ma SSD amathandizira, amakhala okwera mtengo komanso osakwanira. Choyambitsa chake nthawi zambiri chimakhala mapulogalamu osagwira ntchito omwe amachita zofunsira zazing'ono, zomwazika za database. Kukonza ma code ogwiritsira ntchito ndi mafunso a database kuti muchepetse I/O mwachisawawa ndikothandiza kwambiri. Mayankho monga Mewayz, ndi ma modules ake 207 omwe adamangidwa kale kuyambira pa $ 19 / mwezi, adapangidwa kuti aziwongolera njira zopezera deta bwino.

Choyamba ndi chiyani kuti muzindikire ngati I/O ndi vuto langa?

Yambani ndi zida zowunika momwe pulogalamu yanu ikugwirira ntchito. Yang'anani ma metric a database omwe akuwonetsa ntchito zowerengera / kulemba kwambiri pa sekondi imodzi (IOPS) komanso nthawi yofunsa pang'onopang'ono. Lembani mbiri ya pulogalamu yanu kuti mudziwe mafunso ang'onoang'ono. Ngati wogwiritsa ntchito m'modzi ayambitsa mafoni angapo achinsinsi m'malo mwa ochepa ochita bwino, mwina mwapeza nkhani yachisawawa ya I/O yomwe ikufunika kuthana nayo.

Try Mewayz Free

All-in-one platform for CRM, invoicing, projects, HR & more. No credit card required.

Start managing your business smarter today

Join 30,000+ businesses. Free forever plan · No credit card required.

Ready to put this into practice?

Join 30,000+ businesses using Mewayz. Free forever plan — no credit card required.

Start Free Trial →

Ready to take action?

Start your free Mewayz trial today

All-in-one business platform. No credit card required.

Start Free →

14-day free trial · No credit card · Cancel anytime