Sub-Millisecond RAG kan Apple Silicon kan. Server tɛ yen. API tɛ yen. Dosiyɛri kelen

\u003ch2\u003eSub-Millisecond RAG kan Apple Silicon kan. Server tɛ yen. API tɛ yen. Filen kelen\u003c/h2\u003e \u003cp\u003eNin GitHub da wulilen marayɔrɔ in bɛ dɛmɛba jira yiriwalikɛlaw ka ɲɛnamaya kɛcogo la. Porozɛ in bɛ bi yiriwali walew ni jɛkafɔ kodɔnni jira.\u003c/p\u003e \u003ch3\u003eFɛɛrɛbɔcogo\u003c/h3\u003e \u003cp\u003eA ka c'a la, marayɔrɔ in kɔnɔ:\u003c/p\u003e \u003cul\u003e \u003cli\u003eKode saniyalen, sɛbɛnnen ɲuman\u003c/li\u003e \u003cli\u003eREADME dafalen ni baarakɛcogo misaliw\u003c/li\u003e \u003cli\u003eBɔli nɔfɛtaama ni bolomafaraw laadilikanw\u003c/li\u003e \u003cli\u003eKunnafoni kura ni ladonni tuma bɛɛ\u003c/li\u003e \u003c/ul\u003e \u003ch3\u003eSigida ka nɔ bilali\u003c/h3\u003e \u003cp\u003ePorozɛ dafalen minnu bɛ i n'a fɔ nin, olu bɛ dɔnniya tila-tila sabati ani ka fɛɛrɛ kuraw teliya kode sɔrɔlenw fɛ ani jɛ-ka-baara yiriwali fɛ.\u003c/p\u003e

Ɲininkali minnu bɛ kɛ tuma caman na

RAG ye mun ye ani mun na milisekɔndi fitinin teliya nafa ka bon ?

RAG (Retrieval-Augmented Generation) ye fɛɛrɛ ye min bɛ AI jaabiw yiriwa ni sigida dɔnniyada ye min bɛ tali kɛ o la ka sɔrɔ ka jaabi sɔrɔ . Sub-millisecond retrieval kɔrɔ ye ko lookup overhead bɛ se ka ye kosɛbɛ, o bɛ AI kɛ i n’a fɔ a bɛ kɛ yɔrɔnin kelen. Ni baarakɛlaw bɛ sigida AI baarakɛminɛnw jɔ walima ka hakilinaw don porogaramuw kɔnɔ, o teliya bɛ latency buttleneck bɔ yen min bɛ sankaba-based retrieval pipelines tɔɔrɔ tuma caman na—makɔnɔni tɛ kɛ rezow ni segin-ka-bɔnyew kan walima API hakɛ dantigɛliw kan.

Yala ne mago bɛ serwɛri walima sankaba API la walasa ka nin baara in kɛ wa ?

Ayi. O de ye nin porozɛ in jɔyɔrɔba ye—fɛn bɛɛ bɛ baara kɛ i ka Apple Silicon Mac kan pewu, sigida la ani ɛntɛrinɛti kɔkan. Server tɛ yen ka provision kɛ, API key tɛ yen ka ɲɛnabɔ, ani baarakɛcogo musaka tɛ yen ɲininkali kelen-kelen bɛɛ la. O ka ɲi kosɛbɛ baarakɛcogo minnu bɛ mɔgɔ dogoyɔrɔw la walima yɔrɔ minnu na fiɲɛ bɛ yɔrɔ minnu na. N’i bɛ fɛn bɛɛ lajɛlen jɔyɔrɔba ɲini, Mewayz bɛ modulu 207 dilan dɔrɔmɛ 19/kalo, AI baarakɛminɛnw fana bɛ o la minnu bɛ sigida baarakɛcogo dafa ni sankaba-baarakɛminɛnw ye ni jɛɲɔgɔnya bɛ sɔrɔ.

Mun de b' a to Apple Silicon bɛ bɛn kosɛbɛ sigida RAG ma kɛrɛnkɛrɛnnenya la ?

Apple Silicon puwɛntiw (M1 ani kɔfɛ) bɛ hakilijagabɔ kɛcogo kelen jira min kɔnɔ CPU, GPU ani Neural Engine bɛ hakilijagabɔlan kelen jɛ. O bɛ kunnafonidilanw tali kuntaala bɔ baarakɛyɔrɔw ni ɲɔgɔn cɛ, o bɛ kɛ sababu ye ka vektɔri bɔɲɔgɔnko ɲininiw kɛ ani ka inference (daɲɛw) doncogo teliya kosɛbɛ. O kɔlɔlɔ ye ko baarakɛcogo minnu tun bɛna GPU fɛnɲɛnamafagalan kɛrɛnkɛrɛnnenw walima yɔrɔjan baarakɛminɛnw de wajibiya cogoya la, olu bɛ se ka baara kɛ ka ɲɛ baarakɛcogo kelen na MacBook kan, o bɛ se ka kɛ sababu ye ka milisekɔndi fitininw sɔrɔli waatiw kɛ nin porozɛ in bɛ minnu jira.

ne bɛ se ka nin fɛɛrɛ in sɛgɛsɛgɛ cogo di sɛnɛfɛnw dilanni baarakɛminɛn dɔ kama ?

Mɔgɔ yɛrɛ ka porozɛw walima jɛkulu fitininw ka porozɛw kama, nin dosiye kelen kɛcogo in bɛ se ka kɛ, wa a cɛ ka ɲi. Walasa ka fɛn dilanni hakɛ sɔrɔ—ka baarakɛla caman minɛ, kunnafonidilan suguya caman, ani baarakɛcogo otomatiki—i mago bɛna kɛ baarakɛminɛnw na minnu ka bon kosɛbɛ. Plateforme minnu bɛ i n’a fɔ Mewayz, olu bɛ modulu 207 fara ɲɔgɔn kan, AI, CRM, kɔnɔkow, ani jateminɛ baarakɛminɛnw bɛ minnu na, dɔrɔmɛ 19/kalo, o bɛ sigida ɲɛnabɔlen di ekipuw ma walasa ka sigida prototypes bonya ka kɛ fɛn dafalenw ye k’a sɔrɔ u ma infrastructures jɔ kokura ka bɔ fɛn fɔlɔ la. Sigida RAG misali min jirala yan, o bɛ se ka kɛ hakilitigiya ye fɛn dilanniba dɔ kɔnɔ.

dafalen ye