← All data sources← All AI Readiness observatories on IDLI

data source

Hugging Face Hub (datasets)

Open Hugging Face Hub (datasets)

Language-tagged datasets on the Hub. Strong signal that a language is trainable.

datasetsHub
Languages in this snapshot
95
presence sample
Filter parameter
?filter=
same as models
Also feeds
Language Resources
Count type
Presence sample

Languages in Hugging Face Hub (datasets)

95 of 95 shown

Detail
ab
abk
Yesdetail →
af
afr
Yesdetail →
ak
aka
Yesdetail →
Amharic
amh
Yesdetail →
Arabic
ara
Yesdetail →
as
asm
Yesdetail →
av
ava
Yesdetail →
ay
aym
Yesdetail →
az
aze
Yesdetail →
ba
bak
Yesdetail →
Bambara
bam
Yesdetail →
be
bel
Yesdetail →
Bengali
ben
Yesdetail →
bg
bul
Yesdetail →
bi
bis
Yesdetail →
br
bre
Yesdetail →
Burmese
mya
Yesdetail →
ca
cat
Yesdetail →
ce
che
Yesdetail →
Cebuano
ceb
Yesdetail →
Central Kurdish
ckb
Yesdetail →
Chinese
zho
Yesdetail →
cv
chv
Yesdetail →
cy
cym
Yesdetail →
Czech
ces
Yesdetail →
da
dan
Yesdetail →
Dutch
nld
Yesdetail →
dv
div
Yesdetail →
dz
dzo
Yesdetail →
ee
ewe
Yesdetail →
English
eng
Yesdetail →
eo
epo
Yesdetail →
et
est
Yesdetail →
eu
eus
Yesdetail →
fi
fin
Yesdetail →
Filipino
fil
Yesdetail →
fj
fij
Yesdetail →
fo
fao
Yesdetail →
French
fra
Yesdetail →
Fulah
ful
Yesdetail →
fy
fry
Yesdetail →
German
deu
Yesdetail →
gn
grn
Yesdetail →
Greek
ell
Yesdetail →
gu
guj
Yesdetail →
Hausa
hau
Yesdetail →
Hebrew
heb
Yesdetail →
Hindi
hin
Yesdetail →
hr
hrv
Yesdetail →
ht
hat
Yesdetail →
hu
hun
Yesdetail →
hy
hye
Yesdetail →
Igbo
ibo
Yesdetail →
Indonesian
ind
Yesdetail →
is
isl
Yesdetail →
Italian
ita
Yesdetail →
Japanese
jpn
Yesdetail →
Javanese
jav
Yesdetail →
ka
kat
Yesdetail →
Kinyarwanda
kin
Yesdetail →
kk
kaz
Yesdetail →
km
khm
Yesdetail →
Korean
kor
Yesdetail →
Kyrgyz
kir
Yesdetail →
Lithuanian
lit
Yesdetail →
Malagasy
mlg
Yesdetail →
Malay
msa
Yesdetail →
Maori
mri
Yesdetail →
N'Ko
nqo
Yesdetail →
Nepali
nep
Yesdetail →
Nyanja
nya
Yesdetail →
Persian
fas
Yesdetail →
Polish
pol
Yesdetail →
Portuguese
por
Yesdetail →
Romanian
ron
Yesdetail →
Russian
rus
Yesdetail →
Serbian
srp
Yesdetail →
Shona
sna
Yesdetail →
Sinhala
sin
Yesdetail →
Somali
som
Yesdetail →
Spanish
spa
Yesdetail →
Swahili
swa
Yesdetail →
Swedish
swe
Yesdetail →
Tamil
tam
Yesdetail →
Telugu
tel
Yesdetail →
Thai
tha
Yesdetail →
Tibetan
bod
Yesdetail →
Turkish
tur
Yesdetail →
Ukrainian
ukr
Yesdetail →
Uyghur
uig
Yesdetail →
Vietnamese
vie
Yesdetail →
Wolof
wol
Yesdetail →
Xhosa
xho
Yesdetail →
Yoruba
yor
Yesdetail →
Zulu
zul
Yesdetail →

Community portal

Opportunities, events, and experts across the digital language inclusion ecosystem.