← All data sources← All Language Processing observatories on IDLI

data source

Per-language pipeline resource listing (tokenize/mwt/pos/lemma/depparse/ner/sentiment/constituency/coref) -- the cleanest pipeline-capability source.

tokenizationmorphological-analysis
Languages with a pipeline
89
Max processors
9
Raw entries scanned
204
Unmatched codes
3
not in the crosswalk

Languages in Stanza

89 of 89 shown

Detail
English
eng
927detail →
German
deu
927detail →
Spanish
spa
927detail →
Chinese
zho
716detail →
French
fra
725detail →
Hebrew
heb
725detail →
Italian
ita
725detail →
Marathi
mar
725detail →
Polish
pol
725detail →
Turkish
tur
725detail →
Arabic
ara
624detail →
Armenian
hye
624detail →
Catalan
cat
624detail →
Czech
ces
624detail →
Danish
dan
615detail →
Dutch
nld
624detail →
Finnish
fin
624detail →
Hindi
hin
615detail →
Indonesian
ind
624detail →
Japanese
jpn
615detail →
Kazakh
kaz
624detail →
Norwegian Bokmål
nob
615detail →
Norwegian Nynorsk
nno
615detail →
Persian
fas
624detail →
Portuguese
por
624detail →
Russian
rus
615detail →
Tamil
tam
624detail →
Ukrainian
ukr
624detail →
Vietnamese
vie
615detail →
Afrikaans
afr
514detail →
Albanian
sqi
523detail →
Ancient Greek (to 1453)
grc
523detail →
Ancient Hebrew
hbo
523detail →
Bulgarian
bul
514detail →
Classical Armenian
xcl
523detail →
Coptic
cop
523detail →
Erzya
myv
523detail →
Estonian
est
523detail →
Galician
glg
523detail →
Georgian
kat
523detail →
Hungarian
hun
514detail →
Icelandic
isl
523detail →
Komi-Zyrian
kpv
523detail →
Latin
lat
523detail →
Ligurian
lij
523detail →
Manx
glv
523detail →
Modern Greek (1453-)
ell
523detail →
Northern Kurdish
kmr
523detail →
Old English (ca. 450-1100)
ang
514detail →
Ottoman Turkish (1500-1928)
ota
523detail →
Scottish Gaelic
gla
523detail →
Sindhi
snd
514detail →
Slovak
slk
523detail →
Swedish
swe
514detail →
Urdu
urd
514detail →
Welsh
cym
523detail →
Western Armenian
hyw
523detail →
Wolof
wol
523detail →
Abkhazian
abk
413detail →
Basque
eus
413detail →
Belarusian
bel
413detail →
Chinese
zho
413detail →
Church Slavic
chu
413detail →
Croatian
hrv
413detail →
Faroese
fao
422detail →
Gothic
got
413detail →
Irish
gle
413detail →
Kirghiz
kir
413detail →
Korean
kor
413detail →
Latvian
lav
413detail →
Literary Chinese
lzh
413detail →
Lithuanian
lit
413detail →
Low German
nds
413detail →
Nigerian Pidgin
pcm
413detail →
Northern Sami
sme
413detail →
Old French (842-ca. 1400)
fro
413detail →
Old Russian
orv
413detail →
Romanian
ron
413detail →
Russia Buriat
bxr
413detail →
Sanskrit
san
413detail →
Serbian
srp
413detail →
Slovenian
slv
413detail →
Telugu
tel
413detail →
Thai
tha
413detail →
Uighur
uig
413detail →
Upper Sorbian
hsb
413detail →
Maltese
mlt
312detail →
Burmese
mya
211detail →
Oriya (macrolanguage)
ori
101detail →

Community portal

Opportunities, events, and experts across the digital language inclusion ecosystem.