Hacker News

Mount Mayhem at Netflix: Scaling Containers kan bi CPUw kan

Kow fɔcogo

15 min read Via netflixtechblog.com

Mewayz Team

Editorial Team

Hacker News

Mount Mayhem at Netflix : Scaling Containers kan bi CPUw kan

Miiri k’a filɛ, i b’a ɲini ka diɲɛ ɲɛnajɛ dɔ labɛn, yɔrɔ min na, jikuru bɛɛ ye ɲɛnajɛ ye min ɲɔgɔn tɛ, min bɛ a yɛrɛ la, nka ɲɛnajɛ sira bɛ to ka Changé, waati tɛ se ka fɔ, wa i bɛ lajɛbaga miliyɔn caman sɔrɔ minnu b’a fɛ ka fɛn bɛɛ lajɛ. Nin ye gɛlɛya ye min bɛ Netflix kan don o don. I n’a fɔ a ye tutigɛbaga ye mikrosɛrɛsiw jɔcogo la, Netflix bɛ baarakɛminɛn suguya ba caman baara, u kelen-kelen bɛɛ bɛ pake kɔnɔ ani ka bila sen kan i n’a fɔ minɛn. San caman kɔnɔ, ka nin mansamara min bɛ minɛn kɔnɔ, o bonya ka ɲɛ, o kɛra baaraba ye, "Mount Mayhem" min ye orchestre, nafolo tila-tila, ani baarakɛcogo labɛnni ye, o bɛɛ bɛ bi CPUw ka dugukoloko gɛlɛnw sanfɛ, minnu kɔnɔna ka ca.

Konteyna gɛlɛya : Densi ni baarakɛcogo

Sankaba-sɔrɔ-baara suguya bɛɛ laɲini ye density (dansi) caman ye : ka minɛn caman boli farikolo-ɲɛnajɛ-sɛbɛn kelen kan walasa ka fɛnɲɛnamafagalanw baara ka caya ani ka musakaw dɔgɔya. Nka, o density ɲinini in bɛ ɲɔgɔn sɔsɔ ni baarakɛcogo magow ye. Bi CPUw, n’u ka jateden kolomaw ka bon ani u ka cache hierarchies gɛlɛnw, olu bɛ gɛlɛya layɛrɛ kura don sen kan. Ni minɛn tan ni caman bɛ ɲɔgɔn sɔrɔ nafolo jɛlenw na i n’a fɔ CPU ka cakɛdaw ani hakilijagabɔ-minɛnw, o nɔ bɛ se ka kɛ "sigiɲɔgɔn mankanba" gɛlɛyaw ye, yɔrɔ min na minɛn kelen min tɛ taamacogo jugu ye, o bɛ se ka minɛn tɔw bɛɛ ka baarakɛcogo tiɲɛ masin kan. Scaling tɛ dɔrɔn ka misali caman daminɛ; o ye ka ɲɛsin fɛnɲɛnamafagalanw ka sinfoni gɛlɛnw ɲɛnabɔli ma walasa ka baarakɛcogo basigilen sabati diɲɛ lamɛnbagaw bolo .

Kulu ladonni : Netflix ka baarakɛminɛnw CPU baarakɛcogo ɲuman kama

Walisa ka se sɔrɔ nin "Mount Mayhem" in kan, Netflix injiniyɛriw ye fɛɛrɛ caman tigɛ minnu bɛ tɛmɛn kosɛbɛ minɛnw bolodacogo jɔnjɔnw kan. U ka fɛɛrɛ ye masterclass ye granular resource management la, ka leveraging technology minnu jɔlen bɛ Linux kernel kɔnɔ ani u yɛrɛ ka orchestration layers kɔnɔ. U ka fɛɛrɛ in kunba ye k’a faamuya ko CPU kɔnɔko tɛ baarakɛcogo nɔgɔman dɔrɔn ye. U bɛ u sinsin yɔrɔ koloma damadɔw kan :

  • CPU Pinning : Ka minɛn kɛrɛnkɛrɛnnenw di CPU cores kɛrɛnkɛrɛnnenw ma walasa ka contexte-switching overhead dɔgɔya ani ka cache locality ɲɛ .
  • doni balansi : minɛnw baara doni tilatilali ni hakilitigiya ye kooriw kɔnɔ walasa kɔnɔbara kelen si kana kɛ buteli kɔnɔ .
  • Tɛnkanw ɲɛnabɔcogo : fɛnɲɛnamafagalanw tigɛcogo ɲɛnabɔli walasa u kana baarakɛcogo kɔrɔlenw tiɲɛ minnu bɛ baarakɛlaw ɲɛnabɔ baarakɛminɛnw na .
  • Kasɛti dɔnni : Minɛnw bolodacogo ni CPU ka kasɛti jɔcogo dɔnni ye, ka baarabolodalenw fara ɲɔgɔn kan walasa ka cakɛda sɔrɔli caya .

Nin fɛɛrɛko baara jugu in de b'a to Netflix bɛ se ka wideyow lase abonɛn miliyɔn 200 ni kɔ ma waati kelen na, ka bɔnɛko minnu bɛ se ka kɛ, olu tigɛli ka kɛ baarakɛcogo ɲuman misali ye.

Orkɛsi kunba : gɛlɛya don jagokɛlaw bɛɛ bolo

K’a sɔrɔ Netflix bɛ baara kɛ ni hakɛba ye, nafolomafɛnw labɛnni nafama gɛlɛya jɔnjɔn bɛ bɛn jago suguya bɛɛ ma min bɛ bi, modulu architectures ta. Gɛlɛya tɛ minɛnw yɛrɛ dɔrɔn na, nka ɲɛnabɔli-yɔrɔ de la min b’a latigɛ u bɛ boli yɔrɔ min na, u bɛ sɛgɛsɛgɛli kɛ cogo min na, ani u bɛ ɲɔgɔn sɔrɔ cogo min na. Nin yɔrɔ in de la kalan minnu bɛ sɔrɔ Netflix ka "Mount Mayhem" la, olu bɛ kɛ diɲɛ bɛɛ kɔnɔ. Jagokɛlaw mago bɛ bi baarakɛcogo la min bɛ se ka nin gɛlɛya in ɲɛnabɔ k’a sɔrɔ a ma SREw ka kulu dɔ wajibiya min bɛ diɲɛ seleke naani kɔnɔ. U mago bɛ kɛnɛ kan min bɛ CPU bolodacogo ni nafolo maracogo gɛlɛya dɔgɔmanw bɔ kɛnɛ kan, k’a to ekipuw k’u sinsin u ka baarakɛminɛnw jɔli n’u bilali kan.

ye

"Sankaba jatebɔ jiginni bɛ ka sɛgɛsɛgɛli gɛlɛya wuli ka bɔ masin virtuwɛliw dicogo dɔrɔn na ka taa baarakɛcogo labɛnni hakili la kernel nivo la. O ye dɔn gɛlɛn ye application logic ni hardware sekow cɛ."

💡 DID YOU KNOW?

Mewayz replaces 8+ business tools in one platform

CRM · Invoicing · HR · Projects · Booking · eCommerce · POS · Analytics. Free forever plan available.

Start Free →
ye

I ka jago sɛgɛsɛgɛli ni mayɛn tɛ

I man kan ka kɛ Netflix ye walasa ka nafa sɔrɔ orchestre barikama la . I mana kɛ microservices bolomafaraw la wo, walima SaaS platform gɛlɛn dɔ, scaling nafama sariyakolow bɛ to kelen ye. Jago OS modulari i n’a fɔ Mewayz dabɔra walasa ka o baarakɛ doni ninnu ɲɛnabɔ. Ni Mewayz ye sigida kelen di walasa ka fɛnw bila senkan, ka kɔlɔsili kɛ, ani ka u yɛrɛ sɛgɛsɛgɛ, o bɛ sira di yiriwali jɛkuluw ma u k’u ka nafolo ɲininiw n’u ka baarakɛcogo sariyaw ɲɛfɔ, k’a sɔrɔ sistɛmu bɛ gɛlɛya basigilenw ɲɛnabɔ. O b’a to i ka baarakɛminɛnw bɛ baara kɛ ka ɲɛ bi fɛnɲɛnɛmaw kan, k’i yɛrɛ tanga "sɔgɔɲɔgɔn mankanba" nɔ ma ani ka baarakɛcogo basigilen mara, o bɛɛ kɛra k’a sɔrɔ i ka kulu ma kɛ Linux kernel scheduling dɔnbagaw ye. A kunba ye, Mewayz b’i dɛmɛ k’i ka baarakɛminɛnw sɛgɛsɛgɛ minnu bɛ minɛn kɔnɔ ni dannaya ye, k’i yɛrɛ ka seko ni dɔnko "Mount Mayhem" tigɛli kɛ baarakɛcogo ye min bɛ taa ɲɛ.

Ɲininkali minnu bɛ kɛ tuma caman na

Mount Mayhem at Netflix : Scaling Containers kan bi CPUw kan

Miiri k’a filɛ, i b’a ɲini ka diɲɛ ɲɛnajɛ dɔ labɛn, yɔrɔ min na, jikuru bɛɛ ye ɲɛnajɛ ye min ɲɔgɔn tɛ, min bɛ a yɛrɛ la, nka ɲɛnajɛ sira bɛ to ka Changé, waati tɛ se ka fɔ, wa i bɛ lajɛbaga miliyɔn caman sɔrɔ minnu b’a fɛ ka fɛn bɛɛ lajɛ. Nin ye gɛlɛya ye min bɛ Netflix kan don o don. I n’a fɔ a ye tutigɛbaga ye mikrosɛrɛsiw jɔcogo la, Netflix bɛ baarakɛminɛn suguya ba caman baara, u kelen-kelen bɛɛ bɛ pake kɔnɔ ani ka bila sen kan i n’a fɔ minɛn. San caman kɔnɔ, ka nin mansamara min bɛ minɛn kɔnɔ, o bonya ka ɲɛ, o kɛra baaraba ye, "Mount Mayhem" min ye orchestre, nafolo tila-tila, ani baarakɛcogo labɛnni ye, o bɛɛ bɛ bi CPUw ka dugukoloko gɛlɛnw sanfɛ, minnu kɔnɔna ka ca.

Konteyna gɛlɛya : Densi ni baarakɛcogo

Sankaba-sɔrɔ-baara suguya bɛɛ laɲini ye density (dansi) caman ye : ka minɛn caman boli farikolo-ɲɛnajɛ-sɛbɛn kelen kan walasa ka fɛnɲɛnamafagalanw baara ka caya ani ka musakaw dɔgɔya. Nka, o density ɲinini in bɛ ɲɔgɔn sɔsɔ ni baarakɛcogo magow ye. Bi CPUw, n’u ka jateden kolomaw ka bon ani u ka cache hierarchies gɛlɛnw, olu bɛ gɛlɛya layɛrɛ kura don sen kan. Ni minɛn tan ni caman bɛ ɲɔgɔn sɔrɔ nafolo jɛlenw na i n’a fɔ CPU ka cakɛdaw ani hakilijagabɔ-minɛnw, o nɔ bɛ se ka kɛ "sigiɲɔgɔn mankanba" gɛlɛyaw ye, yɔrɔ min na minɛn kelen min tɛ taamacogo jugu ye, o bɛ se ka minɛn tɔw bɛɛ ka baarakɛcogo tiɲɛ masin kan. Scaling tɛ dɔrɔn ka misali caman daminɛ; o ye ka ɲɛsin fɛnɲɛnamafagalanw ka sinfoni gɛlɛnw ɲɛnabɔli ma walasa ka baarakɛcogo basigilen sabati diɲɛ lamɛnbagaw bolo .

Kulu ladonni : Netflix ka baarakɛminɛnw CPU baarakɛcogo ɲuman kama

Walisa ka se sɔrɔ nin "Mount Mayhem" in kan, Netflix injiniyɛriw ye fɛɛrɛ caman tigɛ minnu bɛ tɛmɛn kosɛbɛ minɛnw bolodacogo jɔnjɔnw kan. U ka fɛɛrɛ ye masterclass ye granular resource management la, ka leveraging technology minnu jɔlen bɛ Linux kernel kɔnɔ ani u yɛrɛ ka orchestration layers kɔnɔ. U ka fɛɛrɛ in kunba ye k’a faamuya ko CPU kɔnɔko tɛ baarakɛcogo nɔgɔman dɔrɔn ye. U bɛ u sinsin yɔrɔ koloma damadɔw kan :

Orkɛsi kunba : gɛlɛya don jagokɛlaw bɛɛ bolo

K’a sɔrɔ Netflix bɛ baara kɛ ni hakɛba ye, nafolomafɛnw labɛnni nafama gɛlɛya jɔnjɔn bɛ bɛn jago suguya bɛɛ ma min bɛ bi, modulu architectures ta. Gɛlɛya tɛ minɛnw yɛrɛ dɔrɔn na, nka ɲɛnabɔli-yɔrɔ de la min b’a latigɛ u bɛ boli yɔrɔ min na, u bɛ sɛgɛsɛgɛli kɛ cogo min na, ani u bɛ ɲɔgɔn sɔrɔ cogo min na. Nin yɔrɔ in de la kalan minnu bɛ sɔrɔ Netflix ka "Mount Mayhem" la, olu bɛ kɛ diɲɛ bɛɛ kɔnɔ. Jagokɛlaw mago bɛ bi baarakɛcogo la min bɛ se ka nin gɛlɛya in ɲɛnabɔ k’a sɔrɔ a ma SREw ka kulu dɔ wajibiya min bɛ diɲɛ seleke naani kɔnɔ. U mago bɛ kɛnɛ kan min bɛ CPU bolodacogo ni nafolo maracogo gɛlɛya dɔgɔmanw bɔ kɛnɛ kan, k’a to ekipuw k’u sinsin u ka baarakɛminɛnw jɔli n’u bilali kan.

I ka jago sɛgɛsɛgɛli kɛ ni ɲagami tɛ

I man kan ka kɛ Netflix ye walasa ka nafa sɔrɔ orchestre barikama la . I mana kɛ microservices bolomafaraw la wo, walima SaaS platform gɛlɛn dɔ, scaling nafama sariyakolow bɛ to kelen ye. Modulaire business OS i n’a fɔ Mewayz dabɔra ka nin baarakɛ doni ninnu ɲɛnabɔ. Ni Mewayz ye sigida kelen di walasa ka fɛnw bila senkan, ka kɔlɔsili kɛ, ani ka u yɛrɛ sɛgɛsɛgɛ, o bɛ sira di yiriwali jɛkuluw ma u k’u ka nafolo ɲininiw n’u ka baarakɛcogo sariyaw ɲɛfɔ, k’a sɔrɔ sistɛmu bɛ gɛlɛya basigilenw ɲɛnabɔ. O b’a to i ka baarakɛminɛnw bɛ baara kɛ ka ɲɛ bi fɛnɲɛnɛmaw kan, k’i yɛrɛ tanga "sɔgɔɲɔgɔn mankanba" nɔ ma ani ka baarakɛcogo basigilen mara, o bɛɛ kɛra k’a sɔrɔ i ka kulu ma kɛ Linux kernel scheduling dɔnbagaw ye. A kunba ye, Mewayz b’i dɛmɛ k’i ka baarakɛminɛnw sɛgɛsɛgɛ minnu bɛ minɛn kɔnɔ ni dannaya ye, k’i yɛrɛ ka seko ni dɔnko "Mount Mayhem" tigɛli kɛ baarakɛcogo ye min bɛ taa ɲɛ.

aw ka jago OS jɔ bi

k' a ta yɛrɛmahɔrɔnya baarakɛlaw la ka se baaradaw ma , Mewayz bɛ fanga di jagokɛla 138.000+ ma ni modulu 207 ye minnu bɛ ɲɔgɔn kan . A daminɛ fu, i ka sɛgɛsɛgɛli kɛ ni i bonyalen don.

Jatebɔsɛbɛn gansan dabɔ →

Try Mewayz Free

All-in-one platform for CRM, invoicing, projects, HR & more. No credit card required.

Start managing your business smarter today

Join 30,000+ businesses. Free forever plan · No credit card required.

Ready to put this into practice?

Join 30,000+ businesses using Mewayz. Free forever plan — no credit card required.

Start Free Trial →

Ready to take action?

Start your free Mewayz trial today

All-in-one business platform. No credit card required.

Start Free →

14-day free trial · No credit card · Cancel anytime