Hacker News

DjVu n'a ni Deep Learning (2023) cɛsirilen don .

DjVu n'a ni Deep Learning (2023) cɛsirilen don . Nin ɲinini in bɛ don djvu kɔnɔ, k’a nafa n’a nɔfɛkow sɛgɛsɛgɛ. Hakilila jɔnjɔn minnu bɛ dabɔ Nin kɔnɔkow bɛ sɛgɛsɛgɛli kɛ: Sariyakolo jɔnjɔnw ni miiriyaw Prac...

12 min read Via scottlocklin.wordpress.com

Mewayz Team

Editorial Team

Hacker News

DjVu n' a ni kalan jugu cɛsira ( 2023 ): i ka kan ka min dɔn

DjVu ye sɛbɛnw cogoya ye min bɛ sɛgɛsɛgɛ, min dabɔra fɔlɔ sɛbɛnw skanlenw ni nizɛri sɛbɛnmarayɔrɔw kama, wa a ni kalan jugu cɛsirilen don, o bɔra kɛnɛ kan i n’a fɔ ɲɔgɔndanba dɔ min bɛ mɔgɔ bila ka wale kɛ bi sɛbɛnw dilanni na min bɛ tali kɛ AI fɛ. Ni masin kalan fɛɛrɛw bɛ ka caya ka taa a fɛ, DjVu ka fɛn dilanni n’a ka kodeli fɛɛrɛw kɛra kalanyɔrɔ nafamaw ye ani a bilali laɲiniw ye, minnu bɛ kɛ ni hakilijagabɔ siraw ye minnu bɛ sɛbɛnw nizɛrikanba ɲɛnabɔ.

DjVu ye mun ye tigitigi ani mun na a nafa ka bon AI waati la ?

DjVu (a fɔcogo ye "déjà vu") dabɔra san 1990 labanw na AT&T Labs la, k'a kɛ gɛlɛya basigilen dɔ ɲɛnabɔcogo ye : i bɛ se ka sɛbɛn skanlenw mara cogo di ka ɲɛ ani k'u ci ka ɲɛ, k'a sɔrɔ i ma jogo saraka ? O cogoya bɛ baara Kɛ ni layɛrɛ-dafalen-fɛɛrɛ ye min bɛ sɛbɛn dɔ Bɔ ɲɔgɔn na ka Kɛ ɲɛfɛla (sɛbɛnni, layini ja), kɔkanna (ja kulɛrilenw), ani mask (cogo kunnafoniw) layɛrɛw ye. Layɛrɛ kelen-kelen bɛɛ bɛ Dòn a yɛrɛma ni algorisimu kɛrɛnkɛrɛnnenw ye kosɛbɛ.

Min bɛ DjVu nafa kɛrɛnkɛrɛnnenya la bi, o ye ko nin fɛn caman tiɲɛni in bɛ fɛnɲɛnɛma bɔli jira min bɛ kalan juguw sigicogo ɲɛfɔ. Misali la, convolutional neural networks (CNNs), olu bɛ jaw baara ni dakunw dɔnni ye, o kɔfɛ, u bɛ cogoyaw dɔn, o kɔfɛ, u bɛ jɔcogo sanfɛtaw dɔn — o ye ɲɛtaa ye min ni DjVu bɛ sɛbɛnw tila-tila cogo min na ka kɛ fɛn fɔlɔw yelenw ye, o bɛ tali kɛ ɲɔgɔn na kosɛbɛ. O sigicogo paralɛli in tɛ kalanko dɔrɔn ye; a bɛ na ni nɔ ɲumanw ye AI sitɛmuw degecogo la walasa ka tariku sɛbɛnw kalan, k’u tila, ani ka kɔrɔ bɔ u la.

Kalan jugu misaliw bɛ dege cogo di DjVu sɛbɛnw marayɔrɔ kan ?

Gafemarayɔrɔbaw — Ɛntɛrinɛti Archive fana sen bɛ o la, min bɛ DjVu dosiye miliyɔn caman ladon — kɛra sanubɔyɔrɔw ye walasa ka ɲɛda cogoya dɔnni (OCR) dege ani sɛbɛnw faamuyali misaliw. Kalan jugu ɲininikɛlaw bɛ baara kɛ ni DjVu ka sɛbɛnmarayɔrɔw ye bawo a cogoya bɛ sɛbɛnnikɛcogo ɲɛfɔcogo ɲumanw mara hali ni degun hakɛ dantɛmɛnen don, o b’a to a ka fisa ni JPEG sɛgɛsɛgɛli bɔnɛnenw ye kalan baara minnu bɛ kɔlɔsi.

Bi transformateur-based models i n’a fɔ LayoutLM ani DocFormer labɛnna ka ɲɛ kunnafonidilanw kan minnu kɔnɔ DjVu-sourced kɔnɔkow bɛ sɔrɔ. O misaliw bɛ dege ka yɔrɔ labɛncogo ni kɔrɔko kɔrɔ siri ɲɔgɔn na — k’a faamu ko kuncɛlan ja gɛlɛn bɛ nafa jira walima ko kulu tiɲɛni bɛ dakun caman caman cili jira. DjVu ka layini saniyalen farali bɛ dugukolo-tiɲɛ sɛbɛnni nɔgɔya kosɛbɛ, ka dɔ bɔ labeli sanfɛla la min bɛ ɔridinatɛri yeli kalan pibiliki caman tɔɔrɔ.

ye

"DjVu ka fɛn dilanni hakilila min ye ka gɛlɛyaw tiɲɛ ka kɛ layɛrɛw ye minnu bɛ se ka ɲɛnabɔ, minnu bɛ se ka ɲɛnabɔ u yɛrɛma, o ye sariya ye min kalan jugu ye min sɔrɔ kokura san tan caman kɔfɛ — wa jɛɲɔgɔnya min bɛ u fila ni ɲɔgɔn cɛ, o bɛ ka ɲɛtaa dɔw lase sɛbɛnw hakililata la minnu tun tɛ se ka miiri tuma min na o cogoya bɔra fɔlɔ."

ye

DjVu-Informed Deep Learning Systems baarakɛcogo ɲuman ye mun ye ?

DjVu ka sɛbɛnmarayɔrɔw ni kalan juguw faralen ɲɔgɔn kan, o nɔ lakika bɛ ka ye kaban izini caman kɔnɔ. Baarakɛminɛn jɔnjɔnw ye ninnu ye:

  • Tariki sɛbɛnw digitɛrili : Baarakɛda minnu bɛ i n’a fɔ jamana ka gafemarayɔrɔw ani kalanko sɛbɛnmarayɔrɔw, olu bɛ ka baara kɛ ni DjVu ka AI ye min kalanna walasa ka bololasɛbɛnw, sariyasɛbɛnw, ani sɛbɛnw minnu man ca, olu sɛbɛnni kɛ otomatiki ye, minnu bɛna hadamadenw ka gafesɛbɛnnaw ta san tan caman kɔnɔ walasa u ka baara kɛ ni bolo ye.
  • Sariya ni sariya labatoli sɛbɛnw sɛgɛsɛgɛli : sariyasobaw ni wariko tɔnw bɛ misaliw bila senkan minnu kalanna DjVu ka bɛnkansɛbɛnw gafemarayɔrɔw kan walasa ka dakunw bɔ, ka faratikanw dɔn, ani ka sariyasunba koɲɛw jira sɛgɛsɛgɛli la.
  • Dɔgɔtɔrɔso sɛbɛnw baaracogo : kɛnɛyako siratigɛw bɛ ka banabagatɔw ka dosiye kɔrɔw sɛmɛntiya minnu maralen bɛ DjVu cogo la ka kɛ kɛnɛyako sɛbɛnw ye minnu labɛnna, minnu bɛ se ka ɲini ɛntɛrinɛti kan, ni AI pibilikiw ye minnu bɛ sɛgɛsɛgɛli sɛbɛnw ni bololasɛbɛnw mara.
  • Kalanko ɲinini teliya : Dɔnniyakɛlaw bɛ baara kɛ ni kalan juguw ye minnu kalanna dɔnniya gafemarayɔrɔw kan (u caman tilalen don ni DjVu ye) walasa ka sɛbɛnw lajɛbaw kɛ, ka citation network sɛgɛsɛgɛli kɛ, ani ka hakilinaw bɔli kɛ.
  • Bɔli ni kɔnɔkow ɲɛnabɔli : kunnafonidilanw bɛ kunnafonidilanw taamasiyɛnw kɛ otomatiki la, josariyaw ɲɛnabɔli, ani kɔnɔkow labɛncogo kura kɛli n’u ka DjVu sɛbɛnmarayɔrɔw baara ye sɛbɛnw faamuyali misaliw fɛ .

Kalan jugu bɛ gɛlɛya jumɛnw sɔrɔ ni DjVu filew baara bɛ kɛ ?

Hali ni jɛɲɔgɔnya layidu talen don , fɛɛrɛko gɛlɛyabaw bɛ yen . DjVu ka codec propriétaire compression kɔrɔ ye ko raw neural networks tɛ se ka format baara kɛ natively — sɛbɛnw ka kan ka decode fɔlɔ ani ka rasterized ka sɔrɔ ka balo ka don standard image-based models kɔnɔ. Nin dekodɔn taabolo in bɛ preprocessing latency ni jogo tiɲɛni seko jira ni paramɛtɛrɛw ma labɛn ka ɲɛ.

💡 DID YOU KNOW?

Mewayz replaces 8+ business tools in one platform

CRM · Invoicing · HR · Projects · Booking · eCommerce · POS · Analytics. Free forever plan available.

Start Free →

Ka fara o kan , dakun caman sigicogo min b'a to DjVu bɛ baara kɛ kosɛbɛ hadamaden kalanbagaw bolo , o bɛ gɛlɛya lase kalan juguw pibilikiw ma minnu bɛ bɔ laban na ka taa laban na . Yeli fɛn caman tigɛlikɛla fanba bɛ ja tensor kelen makɔnɔ; ɲɛfɛla ni kɔkanna layiniw baloli danfara la, o bɛ ladamu architectures walima fusion layers de wajibiya minnu bɛ modeli gɛlɛya fara a kan. Ɲininikalaw bɛ ka jateminɛ kɛcogo dɔw sɛgɛsɛgɛ kosɛbɛ minnu bɛ se ka baara kɛ u yɛrɛ la DjVu ka jiracogo tiɲɛnenw kan, minnu bɛna nafa caman sɔrɔ baarakɛcogo ɲuman na sɛbɛnw dilanni baarakɛcogobaw la.

DjVu ni Neural Document Processing bɛna mun kɛ siniɲɛsigi la ?

Ni an ye ɲɛfɛla lajɛ , taabolo jɛlen don : ni kalan jugu misaliw bɛ se ka kɛ ani ka baara kɛ ka ɲɛ , DjVu sɛbɛnw marayɔrɔbaw bɛna kɛ fɛn ye min bɛ se ka sɔrɔ ka taa a fɛ ani nafa bɛna bonya ka taa a fɛ Kanba misali caman minnu bɛ se ka sɛbɛnni, layidu ani ja kɔnɔkow baara waati kelen na, olu bɛ ka sɛbɛnw faamuyali minɛ kaban i n’a fɔ baara kelen sanni ka kɛ senfɛtaama danfaralenw pibiliki ye.

Retrieval-augmented generation (RAG) sigidaw wulicogo fana bɛ DjVu ka sɛbɛnmarayɔrɔw jɔyɔrɔ fa i n’a fɔ dɔnniya jɔnjɔnw . Jɛkulu minnu bɛ wari bila sisan u ka DjVu dalajɛw jiginni n’u index (index) la, olu bɛna daminɛba sɔrɔ baarakɛda AI dɛmɛbagaw bilali la minnu bɛ se ka ɲininkaliw jaabi minnu sinsinnen bɛ sigida dɔnniya kan minnu bɛ san tan caman kɔnɔ.


Ɲininkali minnu bɛ kɛ tuma caman na

Ne bɛ se ka DjVu filenw sɛmɛntiya ka kɛ cogoyaw ye minnu bɛ bɛn bi AI baarakɛminɛnw ma wa ?

Ɔwɔ. Baarakɛminɛn dafalenw i n’a fɔ DjVuLibre ani jagokɛlaw bɛ se ka DjVu filenw dekodɔn ka kɛ PDF, TIFF walima PNG cogoyaw ye minnu bɛ dɛmɛ sɔrɔ u yɛrɛ la kalanko jugu fanba fɛ. Walasa ka baara kɛ ni fɛn caman ye, cikan-sira-pibilikiw bɛ se ka fɛn caman tigɛli kɛ otomatiki la sɛbɛnmarayɔrɔ bɛɛ kɔnɔ, hali n’i ka kan ka bɔli jogo sɛmɛntiya ciden misali dɔ kan sani i ka fɛn caman tigɛli kɛ.

Yala DjVu bɛ ka yiriwa kosɛbɛ hali bi wa walima a ye ciyɛn cogoya ye wa ?

DjVu ye fɔlɔ ye ciyɛn cogoya ye nin waati in na , yiriwali waleyali jɔlen don kosɛbɛ kabini san 2000 cɛmancɛ . Nka, a bɛ to ka baara kɛ kosɛbɛ nizɛri gafemarayɔrɔw ka ɲɛnamaya kɛcogo la, k’a sababu kɛ kunnafoni minnu bɛ yen, olu hakɛ cayalenba ye, minnu maralen bɛ o cogo la. Kalan jugu bɛ ka ɲɛnamaya filanan di DjVu ma kosɛbɛ, k’a kɛ sɔrɔko siratigɛ la, dɔnniya minnu sirilen bɛ o sɛbɛnmarayɔrɔ ninnu kɔnɔ, olu bɔ ani k’u baara.

DjVu ka sɛgɛsɛgɛli bɛ se ka suma cogo di ni PDF ye kalan jugu kalanni kunnafoniw kama ?

A ka c’a la, DjVu bɛ se ka sɛgɛsɛgɛli kɛcogo ɲuman sɔrɔ siɲɛ 5–10 ka tɛmɛ PDF kan sɛbɛnw sɛgɛsɛgɛlenw kama k’a sɔrɔ a bɛ yecogo kantigiya caman mara dosiye hakɛw la minnu bɛ bɛn ɲɔgɔn ma. O b’a to DjVu-sourced datasets bɛ mara ka ɲɛ kosɛbɛ kalan pibilikiw kama, hali ni format in ka dɛmɛba dɔgɔyali kɔrɔ ye ko baarakɛminɛn wɛrɛw ka kan ka kɛ ka kɔn baarakɛcogo ɲɛ n’i y’a suma ni PDF ekosisɛti ye min bɛ yɔrɔ bɛɛ.


Baarakɛminɛnw, baarakɛcogo ani dɔnniya siraw ɲɛnabɔli minnu bɛ fanga di bi AI-driven baarakɛcogo ma — k’a ta sɛbɛnw labɛnni na ka se kɔnɔkow ɲɛnabɔli ma — o bɛ taabolo dɔ de wajibiya min jɔra gɛlɛya kama sɛgɛsɛgɛli la. Mewayz ye jagokɛyɔrɔ ye min bɛ se ka kɛ ni modulu 207 ye, baarakɛla 138.000 ni kɔ dalen bɛ a la walasa k’u ka jɛkulu fan bɛɛ labɛn, k’a daminɛ dɔrɔmɛ 19 dɔrɔn na kalo kɔnɔ. I mana kɛ ka sɛbɛnmarayɔrɔw kɛ nizɛrikan na, i mana sɛbɛnw baarakɛcogo kɛ otomatiki ye wo, walima i mana dɔnniyaw jɔ minnu bɛ baara kɛ ni AI labanw ye, Mewayz bɛ fɛnsɔrɔsiraw di i ma walasa k’o bɛɛ kɛ yɔrɔ kelen na.

I ka Mewayz taama daminɛ bi app.mewayz.com ani k’a dɔn jagokɛla ka OS kelen bɛ i ka jɛkulu ka baara kɛcogo sɛmɛntiya cogo min na, k’a sɛgɛsɛgɛ, ani ka fɛn kuraw don.

Try Mewayz Free

All-in-one platform for CRM, invoicing, projects, HR & more. No credit card required.

Start managing your business smarter today

Join 30,000+ businesses. Free forever plan · No credit card required.

Ready to put this into practice?

Join 30,000+ businesses using Mewayz. Free forever plan — no credit card required.

Start Free Trial →

Ready to take action?

Start your free Mewayz trial today

All-in-one business platform. No credit card required.

Start Free →

14-day free trial · No credit card · Cancel anytime