← All data sources← All Language Processing observatories on IDLI

data source

fastText LID (NLLB)

Open fastText LID (NLLB)

217 FLORES-200 labels from Meta's NLLB language-identification model.

language-id
Languages identifiable
211
Total script labels
218

Languages in fastText LID (NLLB)

211 of 211 shown

Detail
Achinese
ace
2detail →
Banjar
bjn
2detail →
Central Kanuri
knc
2detail →
Chinese
zho
2detail →
Kashmiri
kas
2detail →
Standard Arabic
arb
2detail →
Tamasheq
taq
2detail →
Abkhazian
abk
1detail →
Adyghe
ady
1detail →
Afrikaans
afr
1detail →
Akan
aka
1detail →
Amharic
amh
1detail →
Armenian
hye
1detail →
Assamese
asm
1detail →
Asturian
ast
1detail →
Awadhi
awa
1detail →
Ayacucho Quechua
quy
1detail →
Balinese
ban
1detail →
Bambara
bam
1detail →
Bashkir
bak
1detail →
Basque
eus
1detail →
Belarusian
bel
1detail →
Bemba (Zambia)
bem
1detail →
Bengali
ben
1detail →
Bhojpuri
bho
1detail →
Bislama
bis
1detail →
Bosnian
bos
1detail →
Buginese
bug
1detail →
Bulgarian
bul
1detail →
Burmese
mya
1detail →
Cameroon Pidgin
wes
1detail →
Catalan
cat
1detail →
Cebuano
ceb
1detail →
Central Atlas Tamazight
tzm
1detail →
Central Aymara
ayr
1detail →
Central Kurdish
ckb
1detail →
Chechen
che
1detail →
Chhattisgarhi
hne
1detail →
Chichewa
nya
1detail →
Chokwe
cjk
1detail →
Chuvash
chv
1detail →
Crimean Tatar
crh
1detail →
Croatian
hrv
1detail →
Czech
ces
1detail →
Danish
dan
1detail →
Dari
prs
1detail →
Dimli (individual language)
diq
1detail →
Dutch
nld
1detail →
Dyula
dyu
1detail →
Dzongkha
dzo
1detail →
Eastern Yiddish
ydd
1detail →
English
eng
1detail →
Esperanto
epo
1detail →
Estonian
est
1detail →
Ewe
ewe
1detail →
Ewondo
ewo
1detail →
Faroese
fao
1detail →
Fijian
fij
1detail →
Finnish
fin
1detail →
Fon
fon
1detail →
French
fra
1detail →
Friulian
fur
1detail →
Galician
glg
1detail →
Ganda
lug
1detail →
Georgian
kat
1detail →
German
deu
1detail →
Goan Konkani
gom
1detail →
Guarani
grn
1detail →
Gujarati
guj
1detail →
Haitian
hat
1detail →
Halh Mongolian
khk
1detail →
Hausa
hau
1detail →
Hebrew
heb
1detail →
Hindi
hin
1detail →
Hungarian
hun
1detail →
Icelandic
isl
1detail →
Igbo
ibo
1detail →
Iloko
ilo
1detail →
Indonesian
ind
1detail →
Iranian Persian
pes
1detail →
Irish
gle
1detail →
Iron Ossetic
oss
1detail →
Italian
ita
1detail →
Japanese
jpn
1detail →
Javanese
jav
1detail →
Kabiyè
kbp
1detail →
Kabuverdianu
kea
1detail →
Kabyle
kab
1detail →
Kachin
kac
1detail →
Kalaallisut
kal
1detail →
Kamba (Kenya)
kam
1detail →
Kannada
kan
1detail →
Karachay-Balkar
krc
1detail →
Kazakh
kaz
1detail →
Khmer
khm
1detail →
Kikuyu
kik
1detail →
Kimbundu
kmb
1detail →
Kinyarwanda
kin
1detail →
Kirghiz
kir
1detail →
Kongo
kon
1detail →
Korean
kor
1detail →
Lao
lao
1detail →
Latgalian
ltg
1detail →
Ligurian
lij
1detail →
Limburgan
lim
1detail →
Lingala
lin
1detail →
Lithuanian
lit
1detail →
Lombard
lmo
1detail →
Luba-Lulua
lua
1detail →
Luo (Kenya and Tanzania)
luo
1detail →
Lushai
lus
1detail →
Luxembourgish
ltz
1detail →
Macedonian
mkd
1detail →
Magahi
mag
1detail →
Maithili
mai
1detail →
Malayalam
mal
1detail →
Maltese
mlt
1detail →
Manipuri
mni
1detail →
Maori
mri
1detail →
Mapudungun
arn
1detail →
Marathi
mar
1detail →
Minangkabau
min
1detail →
Mingrelian
xmf
1detail →
Modern Greek (1453-)
ell
1detail →
Mossi
mos
1detail →
Navajo
nav
1detail →
Nepali (individual language)
npi
1detail →
Nias
nia
1detail →
Nigerian Fulfulde
fuv
1detail →
Nigerian Pidgin
pcm
1detail →
North Azerbaijani
azj
1detail →
Northern Kurdish
kmr
1detail →
Northern Uzbek
uzn
1detail →
Norwegian Bokmål
nob
1detail →
Norwegian Nynorsk
nno
1detail →
Nuer
nus
1detail →
Occitan (post 1500)
oci
1detail →
Odia
ory
1detail →
Pangasinan
pag
1detail →
Panjabi
pan
1detail →
Papiamento
pap
1detail →
Pedi
nso
1detail →
Plateau Malagasy
plt
1detail →
Polish
pol
1detail →
Portuguese
por
1detail →
Romanian
ron
1detail →
Romansh
roh
1detail →
Rundi
run
1detail →
Russia Buriat
bxr
1detail →
Russian
rus
1detail →
Samoan
smo
1detail →
Sango
sag
1detail →
Sanskrit
san
1detail →
Santali
sat
1detail →
Sardinian
srd
1detail →
Scottish Gaelic
gla
1detail →
Serbian
srp
1detail →
Shan
shn
1detail →
Shona
sna
1detail →
Sicilian
scn
1detail →
Silesian
szl
1detail →
Sindhi
snd
1detail →
Sinhala
sin
1detail →
Slovak
slk
1detail →
Slovenian
slv
1detail →
Somali
som
1detail →
South Azerbaijani
azb
1detail →
Southern Altai
alt
1detail →
Southern Pashto
pbt
1detail →
Southern Sotho
sot
1detail →
Southwestern Dinka
dik
1detail →
Spanish
spa
1detail →
Standard Latvian
lvs
1detail →
Standard Malay
zsm
1detail →
Sundanese
sun
1detail →
Swahili (individual language)
swh
1detail →
Swati
ssw
1detail →
Swedish
swe
1detail →
Tagalog
tgl
1detail →
Tahitian
tah
1detail →
Tajik
tgk
1detail →
Tamil
tam
1detail →
Tatar
tat
1detail →
Telugu
tel
1detail →
Thai
tha
1detail →
Tibetan
bod
1detail →
Tigrinya
tir
1detail →
Tok Pisin
tpi
1detail →
Tonga (Tonga Islands)
ton
1detail →
Tosk Albanian
als
1detail →
Tsonga
tso
1detail →
Tswana
tsn
1detail →
Tumbuka
tum
1detail →
Turkish
tur
1detail →
Turkmen
tuk
1detail →
Twi
twi
1detail →
Udmurt
udm
1detail →
Uighur
uig
1detail →
Ukrainian
ukr
1detail →
Umbundu
umb
1detail →

Showing the first 200 of 211 matches — refine the search to narrow further.

Community portal

Opportunities, events, and experts across the digital language inclusion ecosystem.