How to read this data
← Back to IDLI
zz
zz
Sentence pairs
438
Corpora
2
Snapshots tracked
2
Sentence pairs over time
2026-07-23: 438 sentence pairs
07-23
2026-08-01: 438 sentence pairs
08-01
Paired languages
Paired language
Sentence pairs
↓
Corpora
Tokens
English
en · ISO eng
34
1
831
Mandarin Chinese (China)
zh_CN · ISO cmn
11
1
88,595,472
Mandarin Chinese (Taiwan, Province of China)
zh_TW · ISO cmn
11
1
37,923,529
Portuguese
pt · ISO por
9
1
544,920,889
German
de · ISO deu
7
1
1,234,804,229
Spanish
es · ISO spa
7
1
1,304,210,166
French
fr · ISO fra
7
1
1,657,442,585
Azerbaijani
az · ISO aze
6
1
12,319,340
Malay (macrolanguage)
ms · ISO msa
6
1
66,675,676
Dutch
nl · ISO nld
6
1
467,172,039
Bulgarian
bg · ISO bul
5
1
130,344,841
Bengali
bn · ISO ben
5
1
72,192,317
Czech
cs · ISO ces
5
1
138,677,493
Finnish
fi · ISO fin
5
1
93,671,223
Croatian
hr · ISO hrv
5
1
98,389,381
Japanese
ja · ISO jpn
5
1
162,560,309
Javanese
jv · ISO jav
5
1
4,361,775
Kurdish
ku · ISO kur
5
1
2,680,326
Lithuanian
lt · ISO lit
5
1
61,291,608
Russian
ru · ISO rus
5
1
918,529,522
Somali
so · ISO som
5
1
3,086,757
Tagalog
tl · ISO tgl
5
1
36,736,690
Turkish
tr · ISO tur
5
1
207,872,432
Catalan
ca · ISO cat
4
1
95,174,770
cb
cb
4
1
318,734
Welsh
cy · ISO cym
4
1
11,956,010
Modern Greek (1453-)
el · ISO ell
4
1
92,682,899
Hungarian
hu · ISO hun
4
1
117,521,753
Indonesian
id · ISO ind
4
1
180,038,739
Italian
it · ISO ita
4
1
816,767,340
Kirghiz
ky · ISO kir
4
1
3,019,926
Latvian
lv · ISO lav
4
1
60,557,232
Mongolian
mn · ISO mon
4
1
5,458,735
Norwegian
no · ISO nor
4
1
105,701,073
Chichewa
ny · ISO nya
4
1
1,946,354
Polish
pl · ISO pol
4
1
294,567,044
Romanian
ro · ISO ron
4
1
134,923,058
Slovak
sk · ISO slk
4
1
82,201,013
Albanian
sq · ISO sqi
4
1
30,818,481
Serbian
sr · ISO srp
4
1
37,757,792
Swedish
sv · ISO swe
4
1
150,986,877
Swahili (macrolanguage)
sw · ISO swa
4
1
18,869,715
Telugu
te · ISO tel
4
1
11,223,962
Tajik
tg · ISO tgk
4
1
3,478,189
Ukrainian
uk · ISO ukr
4
1
115,319,900
Afrikaans
af · ISO afr
3
1
25,523,165
Amharic
am · ISO amh
3
1
5,030,292
Belarusian
be · ISO bel
3
1
19,845,359
cx
cx
3
1
2,958,432
Estonian
et · ISO est
3
1
47,065,467
Fulah
ff · ISO ful
3
1
456,837
Hebrew
he · ISO heb
3
1
57,687,679
Igbo
ig · ISO ibo
3
1
2,557,642
Icelandic
is · ISO isl
3
1
18,329,172
Georgian
ka · ISO kat
3
1
16,672,459
Kazakh
kk · ISO kaz
3
1
8,408,063
Khmer
km · ISO khm
3
1
6,579,654
Korean
ko · ISO kor
3
1
93,975,318
Malagasy
mg · ISO mlg
3
1
6,573,905
Macedonian
mk · ISO mkd
3
1
25,040,244
Marathi
mr · ISO mar
3
1
14,645,721
Burmese
my · ISO mya
3
1
5,190,345
Nepali (macrolanguage)
ne · ISO nep
3
1
9,590,585
ns
ns
3
1
96,190
Pushto
ps · ISO pus
3
1
3,993,105
Slovenian
sl · ISO slv
3
1
56,177,298
Swati
ss · ISO ssw
3
1
88,805
Sundanese
su · ISO sun
3
1
5,146,827
Tamil
ta · ISO tam
3
1
22,543,637
Thai
th · ISO tha
3
1
63,261,153
Tswana
tn · ISO tsn
3
1
262,464
Wolof
wo · ISO wol
3
1
440,713
Xhosa
xh · ISO xho
3
1
1,490,556
Yoruba
yo · ISO yor
3
1
3,330,924
Zulu
zu · ISO zul
3
1
1,456,359
Assamese
as · ISO asm
2
1
293,903
Breton
br · ISO bre
2
1
828,663
Gujarati
gu · ISO guj
2
1
2,852,263
Kannada
kn · ISO kan
2
1
2,516,662
Ganda
lg · ISO lug
2
1
60,976
Lingala
ln · ISO lin
2
1
88,415
Lao
lo · ISO lao
2
1
1,204,249
Maori
mi · ISO mri
2
1
2,330,048
Malayalam
ml · ISO mal
2
1
14,918,594
Oromo
om · ISO orm
2
1
95,604
Panjabi
pa · ISO pan
2
1
2,770,956
Sinhala
si · ISO sin
2
1
12,697,985
Shona
sn · ISO sna
2
1
1,394,212
Oriya (macrolanguage)
or · ISO ori
1
1
93,163
Tsonga
ts · ISO tso
1
1
30,726
Venda
ve · ISO ven
1
1
25,944
Download the 2026-08-01 snapshot CSV ↓