Hacker News

Haqiqa farashin I/O bazuwar

Sharhi

12 min read Via vondra.me

Mewayz Team

Editorial Team

Hacker News

Software na Kasuwancin ku yana da hankali fiye da yadda yakamata ya kasance - kuma bazuwar I/O shine mai laifi mara ganuwa

A duk lokacin da abokin ciniki ya koka game da jinkirin dashboard, duk lokacin da ƙungiyar ku ta jira ƙarin daƙiƙa uku don rahoto don ɗauka, kuma duk lokacin da shafin yanar gizon ku ya rasa mai siye don rashin haƙuri - akwai yuwuwar cewaBazuwar I/O na cikin nutsuwa yana kwashe kuɗin shiga. Ba buzzword ba ne da aka tanada don injiniyoyin bayanai. Abu ne mai iya aunawa, ƙulli mai tsada yana ɓoye a cikin kusan kowace aikace-aikacen kasuwanci, daga binciken CRM zuwa tsarar daftari. Fahimtar ainihin farashin sa ba kawai motsa jiki ba ne - na kuɗi ne. Kamfanonin da suka yi watsi da shi suna biyan farashi a cikin kumburan kuɗaɗen girgije, abokan cinikin da suka rasa, da ƙungiyoyin da suka makale a kan allon da ya kamata a ɗauka nan take.

Abinda Bazuwar I/O Ainihin Ma'anarsa (Kuma Me yasa Yayi Tsada)

A ainihinsa, I/O - shigarwa/ fitarwa - shine tsarin karantawa da rubuta bayanai zuwa ajiya. Lokacin da aikace-aikacenku ya ɗauko bayanai daga ma'ajin bayanai, yana loda fayiloli daga faifai, ko rubuta rajistan ayyukan ma'amala, yana aiwatar da ayyukan I/O. Wadannan ayyuka sun zo cikin nau'i biyu: jerida kuma bazuwar. I/O na jeri yana karanta ko rubuta bayanai a cikin tubalan da ke da alaƙa, kamar karanta littafi daga farko zuwa ƙarshe. Random I/O ya yi tsalle ba tare da tsammani ba, kamar juyawa zuwa shafi na 47, sannan shafi na 3, sannan shafi na 812.

Tazarar aiki tsakanin waɗannan alamu biyu yana da ban mamaki. A kan rumbun kwamfutarka na al'ada, karatun jeri-na-yi na iya samun abin da aka samu na 150-200 MB/s, yayin da bazuwar karantawa kan yi rarrafe a 0.5-1.5 MB/s — bambancin 100x ko fiye. Ko da akan NVMe SSDs na zamani, waɗanda ke haɓaka aikin I/O na bazuwar, tazarar har yanzu tana daga 5x zuwa 20x dangane da aikin. Lokacin da aikace-aikacen kasuwancin ku ya ba da dubban ƙananan buƙatun karantawa a cikin sakan daya - jawo sunan abokin ciniki a nan, wani layin daftari a wurin, duba izinin wani wuri - kowane hop yana gabatar da latency da aka auna a cikin microseconds wanda ke shiga cikin sakan na ainihin lokacin jira mai amfani.

Ilimin kimiyyar lissafi bai canza ba cikin shekarun da suka gabata: samun damar bayanai da ke warwatse a cikin ma'adana yana da saurin gudu fiye da watsa shi cikin tsari. Abin da ya canza shine sikelin da aikace-aikacen zamani ke haifar da I/O bazuwar, wanda hakan ya sa farashinsa ba zai yuwu a yi watsi da shi ba.

Harajin da aka ɓoye akan Kowane Ayyukan Kasuwanci

Yi la'akari da abin da ke faruwa idan mai amfani ɗaya ya buɗe dashboard na CRM. Aikace-aikacen yana tambayar tebur na abokin ciniki, yana haɗa shi tare da rajistan ayyukan kwanan nan, yana jan ƙimar ma'amala mai alaƙa, bincika izinin mai amfani, ɗora ƙididdige ƙididdige sanarwar, da fitar da abubuwan zaɓin nuni. Kowane ɗayan waɗannan tambayoyin na iya taɓa tebur daban-daban da aka adana a wurare daban-daban akan faifai. Dashboard ɗin da ke nuna bayanan abokin ciniki 50 na iya haifar da 300 zuwa 500 bazuwar ayyukan I/Oa ƙarƙashin hular. Raba wannan ta hanyar masu amfani guda 200 a lokacin mafi girman sa'o'in kasuwanci, kuma uwar garken bayanan ku tana aiki sama da karatun bazuwar 100,000 a sakan daya.

Wannan ba hasashe ba ne. Wani bincike na 2024 da Percona ya yi ya gano cewa ƙarancin ingantattun kayan aikin bayanai suna kashewa har zuwa68% na jimlar lokacin aiwatar da susuna jiran ayyukan I/O, tare da tsarin samun damar shiga bazuwar shine babban laifi. Ga kamfanin SaaS wanda ke hidima ga dubban kasuwanci, wannan yana fassara kai tsaye zuwa farashin kayan more rayuwa. Masu samar da gajimare suna cajin IOPS (ayyukan I/O a sakan daya), kuma bazuwar I/O-nauyin aiki na iya tura kudaden ajiya na wata-wata daga ɗaruruwa zuwa dubun dubatan daloli - ba saboda ƙarar bayanai ba, amma saboda yanayin samun dama.

Farashin ya wuce abubuwan more rayuwa. Kowane mil 100 na ƙarin lokacin lodin shafi yana rage yawan juzu'i da kusan 7%, bisa ga bincike daga Akamai. Lokacin da bazuwar I/O ta ƙara cikakken daƙiƙa guda ga tsarar daftarin ku ko bayar da rahoton lodi, ba kawai kuna kona lissafin ba - kuna kona kudaden shiga.

Inda Aikace-aikacen Kasuwanci ke Haɓakar Jini

Ba duk fasalulluka ba daidai suke ba idan ya zo ga tsarin I/O. Wasu daga cikin ayyukan kasuwanci na yau da kullun kuma sune mafi munin masu laifi don shiga bazuwar:

  • Bincike da tacewa: Tambayoyi a fagage da yawa (suna, kwanan wata, matsayi, tags) yana tilasta ma'ajin bayanai don duba fihirisar da aka warwatse a cikin ma'adana, suna haifar da karatun bazuwar
  • Dashboard aggregations: Ƙididdigar kudaden shiga, ƙidayar masu amfani, ko ƙididdige daftarin da ba a gama ba yana buƙatar taɓa dubban layuka da aka baje a cikin shafukan bayanai daban-daban
  • Binciken izini: Ikon samun damar tushen rawar aiki a cikin dandamalin masu haya da yawa galibi yana buƙatar dubawa da yawa akan buƙatu - mai amfani → rawar → izini → albarkatun — kowane yana buga tebur daban-daban
  • Bayar da rahoto: Rahoton albashi na wata-wata, taƙaitaccen bayanin kula da jiragen ruwa, ko nazarin HR yana jan bayanai daga teburi da yawa a lokaci ɗaya
  • sanarwa na ainihi:Duba don sabbin saƙonni, sabuntawar ɗawainiya, da faɗakarwar tsarin a cikin nau'ikan samfura suna haifar da ƙarami, tambayoyin bazuwar

Tsarin a bayyane yake: ƙarin kayayyaki da fasalulluka da dandamali ke bayarwa, ƙarin hanyoyin I/O suna ƙaruwa. Kayan aikin haɗin-in-bio mai sauƙi na iya haifar da tambayoyi 10 akan kowane shafi. Cikakken tsarin aiki na kasuwanci tare da CRM, daftari, HR, lissafin albashi, yin ajiyar kuɗi, da ƙirar ƙididdiga - kamar abin da Mewayz ke bayarwa a cikin samfuransa na 207 - na iya haifar da ɗaruruwa a zahiri. Bambance-bambancen da ke tsakanin dandalin da ke jin nan take da wanda yake jin kasala yakan zo ne kan yadda ake sarrafa waɗancan tsarin I/O a bayan fage.

Me yasa Jifar Hardware a Matsala baya Aiki

Ilimi lokacin da aikace-aikacen ke raguwa shine haɓakawa. Manyan sabobin, SSDs masu sauri, ƙarin RAM. Kuma yayin da haɓaka kayan aikin ke taimakawa, suna bin tsarin raguwar dawowar da ke sa CFOs rashin jin daɗi. Ƙirƙirar RAM na uwar garken bayanan ku daga 64GB zuwa 128GB na iya inganta ƙimar cache daga 92% zuwa 96% - riba mai ma'ana, amma sauran 4% na cache har yanzu suna rasa ajiya tare da I/O bazuwar. Sau uku rabon ku na IOPS akan AWS daga 3,000 zuwa 10,000 yana kashe kusan dala 450 a kowane wata amma yana iya haɓaka lokutan amsa p99 da kashi 30%.

Ainihin matsalar ita ce tsarin gine-gine. I/O bazuwar sau da yawa alama ce ta al'amura masu zurfi: ɓacewa ko tsararrun fihirisa, tsarin tambaya N+1 inda aikace-aikacen ke yin kiran bayanai guda ɗaya a kowane abu maimakon batching, madaidaitan tsare-tsare waɗanda ke buƙatar haɗin tebur guda biyar don jeren nuni ɗaya, da rashin karanta kwafi ko yadudduka caching. Haɓaka kayan aiki suna magance alamar. Haɓaka ginin gine-gine yana magance sanadin.

Aikin I/O mafi tsada shi ne wanda bai kamata ya kasance ba tun farko. Ga kowane dala da aka kashe akan ma'aji mai sauri, centi goma da aka kashe akan inganta tambaya yana ba da kyakkyawan sakamako. Kamfanonin da suka yi nasara akan aikin ba su wuce gasar su ba - ba su tunanin tsarin samun bayanan su.

💡 DID YOU KNOW?

Mewayz replaces 8+ business tools in one platform

CRM · Invoicing · HR · Projects · Booking · eCommerce · POS · Analytics. Free forever plan available.

Start Free →

Dabarun Aiki waɗanda A Haƙiƙa suna Rage I/O bazuwar

Rage I/O bazuwar baya buƙatar cikakken sake rubuta aikace-aikacen ku. Yana buƙatar sauye-sauye masu niyya, masu aunawa ga yadda ake adana bayanai, samun dama da kuma cache. Anan akwai dabarun da ke ba da tasiri mafi girma:

  1. Yi aiwatar da batching na tambaya mai tsauri. Idan dashboard ɗinku ya ɗora wa abokan ciniki 50 da ayyukansu na baya-bayan nan, ɗauko duk saitin ayyuka 50 a cikin tambaya ɗaya ta amfani da INA abokin ciniki_id IN (...) maimakon duban mutum 50. Wannan kadai zai iya rage bazuwar I/O da 80% akan ra'ayoyin jeri.
  2. Amfani da maƙasudai da dabara. Fihirisar haɗaɗɗiya akan ( Tenant_id, status, created_at) yana ba wa ma'aunin damar gamsar da tambayoyin da aka tace gama gari tare da sikanin maƙasudin jeri guda ɗaya maimakon duban bazuwar da yawa a cikin fihirisa daban-daban.
  3. Gaba da ma'aunin caching tare da ɓarna mai hankali. Ana samun damar cache akai-akai amma ba a cika samun canjin bayanai ba - izinin mai amfani, saitunan ƙungiya, saitunan tsarin - a cikin ƙwaƙwalwar ajiya. Redis ko Memcached na iya yin hidimar waɗannan a cikin daƙiƙa guda, yana kawar da dubban bazuwar karatu a minti daya.
  4. Ƙididdigar ƙididdiga kafin a yi lissafin. Kasuwancin ƙaramin adadin sabobin bayanai don raguwa mai yawa a cikin bazuwar I/O.
  5. Rarraba manyan teburi ta hanyar hanyar shiga. Idan kashi 90% na tambayoyin sun taɓa bayanai daga kwanaki 30 na ƙarshe, raba teburin ku ta hanyar kwanan wata don haka ɓangaren aiki ya kasance yana zafi a cikin cache yayin da bayanan tarihi ke zama sanyi akan ajiya mai rahusa.
<> Waɗannan ba fasaha ba ne. Su iri ɗaya ne waɗanda ke ba da damar dandamali masu hidima ga ɗaruruwan dubunnan masu amfani don kiyaye lokutan amsawa na biyu a cikin hadaddun mu'amalar mu'amala mai nau'i-nau'i da yawa. Lokacin da Mewayz ya sake gina gine-ginen sa don V2 - ƙira daga kayan aikin haɗin-in-bio guda ɗaya zuwa 207-module kasuwanci OS da ke aiki sama da masu amfani da 138,000 - haɓaka tsarin samun damar I/O ya kasance tushen haɓaka haɓakar haɓakawa ba tare da ninka farashin kayan aiki daidai ba.

Tasirin Haɗawa akan Ƙwarewar Mai Amfani da Riƙewa

Aiki ba wai kawai abin damuwa ba ne - siffa ce ta samfur. Binciken Google ya nuna a kai a kai cewa53% na masu amfani da wayar suna barin shafin da ya dauki tsawon dakika 3 ana lodawa. Don aikace-aikacen kasuwanci inda masu amfani ke hulɗa da yawa lokuta a kowace rana, haƙurin ya yi ƙasa kaɗan. Manajan biyan kuɗi yana gudanar da rahotanni na mako-mako, jagorar HR da ke bitar masu nema, ko wakilin tallace-tallace yana duba matsayin bututun - waɗannan masu amfani suna haɓaka fahimtar saurin gudu. Wataƙila ba za su iya faɗin "lantarwar I/O ba a kan tambayar tara kuɗin daftari ya yi yawa," amma za su ce "wannan software tana jin jinkirin" kuma su fara tantance hanyoyin.

Tasirin haɓakawa yana iya aunawa. Dandalin da ke loda dashboards a cikin 800ms maimakon 2.4 seconds baya jin 3x da sauri - yana canza halayen amfani. Masu amfani suna bincika bayanai akai-akai, bincika ƙarin kayayyaki, da haɗa kayan aiki da zurfi cikin ayyukansu. Babban haɗin kai yana haifar da riƙewa mai girma, wanda ke haifar da ƙimar rayuwa mafi girma. Slack sanannen ya dangana wani muhimmin kaso na farkon haɓakarsa zuwa haɓaka aikin da ya dace, sanin cewa saurin da kansa ya kasance gasa.

Don dandamalin kasuwanci na duk-in-daya, wannan tasirin yana ƙaruwa a kowane tsari. Idan CRM yana da sauri amma lissafin kuɗi yana jinkirin, fahimtar duk dandamali yana wahala. Matsakaicin aiki a cikin fasalulluka - daga sarrafa ajiyar kuɗi zuwa bin diddigin jiragen ruwa zuwa nazari - yana buƙatar ingantaccen tsarin I/O a ko'ina, ba kawai a cikin mafi kyawun kayayyaki ba.

Aunawa Abin da Yake Muhimmanci: Yin Bazuwar I/O Ganuwa

Ba za ku iya gyara abin da ba ku iya gani ba. Mataki na farko na magance farashin I/O na bazuwar yana sa su ganuwa ga ƙungiyar injiniyoyi da ayyukan ku. Kayan aikin lura na zamani kamar Datadog, Sabon Relic, ko ma buɗaɗɗen tushen mafita kamar Prometheus tare da Grafana na iya bin tsarin IOPS, rarraba latency na tambaya, da cache ya sami ƙima a ainihin lokacin. Ma'auni mafi mahimmanci sune:

  • p95 da p99 latency tambaya:Matsakaicin latency yana ɓoye zafin. Kashi na 95th da 99th na nuna abin da kuka fi jinkiri - kuma mafi takaici - masu amfani a zahiri sun dandana
  • Rushewar IOPS ta hanyar karantawa vs. rubuta, jeri vs. bazuwar: Wannan yana nuna ko aikinku yana ɗaure I/O kuma wane nau'in I/O ya mamaye
  • Rashin bugun cache: Rabo da ke ƙasa da kashi 95 cikin 100 na tsarin da aka gyara yana nuna tsarin samun damar bayanai waɗanda ba a yi amfani da su daga ƙwaƙwalwar ajiya
  • Kidaya tambayoyin kowane shafi: Idan aikin mai amfani guda ɗaya ya haifar da tambayoyin bayanai sama da 20-30, tabbas akwai damar ingantawa

Masu dauke da wannan bayanan, ƙungiyoyi za su iya ba da fifikon inganta mafi girman tasiri maimakon zato. Kasuwancin da ke ɗaukar aikin I/O azaman ma'aunin aji na farko - tare da lokacin aiki, ƙimar kuskure, da gamsuwar mai amfani - koyaushe suna isar da samfuran sauri cikin ƙananan farashi. A cikin kasuwa inda masu amfani ke tsammanin kayan aikin kasuwanci za su kasance masu amsa kamar aikace-aikacen mabukaci, wannan horon ba na zaɓi bane. Bambanci ne tsakanin dandamalin da ke yin ma'auni da kyau ga masu amfani da 138,000 da kuma wanda ke daurewa a ƙarƙashin ƙayyadaddun nasa.

Sanya Kasuwancin ku tare da Mewayz

Mewayz yana kawo nau'ikan kasuwanci guda 207 cikin dandali daya - CRM, daftari, sarrafa ayyuka, da ƙari. Haɗa masu amfani 138,000+ waɗanda suka sauƙaƙa tafiyar aikin su.

Fara A Yau →