How to read this data
← Back to IDLI
qa
qa
Sentence pairs
1,375
Corpora
2
Snapshots tracked
2
Sentence pairs over time
2026-07-23: 1,375 sentence pairs
07-23
2026-08-01: 1,375 sentence pairs
08-01
Paired languages
Paired language
Sentence pairs
↓
Corpora
Tokens
English
en · ISO eng
136
1
3,449
Arabic
ar · ISO ara
22
1
344,455,794
French
fr · ISO fra
22
1
1,657,443,800
German
de · ISO deu
21
1
1,234,805,444
Indonesian
id · ISO ind
21
1
180,039,954
Dutch
nl · ISO nld
21
1
467,173,254
Portuguese
pt · ISO por
21
1
544,922,104
Russian
ru · ISO rus
21
1
918,530,737
Japanese
ja · ISO jpn
20
1
162,561,524
Thai
th · ISO tha
20
1
63,262,368
Turkish
tr · ISO tur
20
1
207,873,647
Mandarin Chinese (China)
zh_CN · ISO cmn
20
1
88,596,687
Vietnamese
vi · ISO vie
19
1
177,844,872
Burmese
my · ISO mya
18
1
5,191,560
Polish
pl · ISO pol
18
1
294,568,259
Romanian
ro · ISO ron
18
1
134,924,273
Norwegian
no · ISO nor
17
1
105,702,288
Bulgarian
bg · ISO bul
16
1
130,346,056
Finnish
fi · ISO fin
16
1
93,672,438
Mandarin Chinese (Taiwan, Province of China)
zh_TW · ISO cmn
16
1
37,924,744
Catalan
ca · ISO cat
15
1
95,175,985
Modern Greek (1453-)
el · ISO ell
15
1
92,684,114
Hungarian
hu · ISO hun
15
1
117,522,968
Lithuanian
lt · ISO lit
15
1
61,292,823
Swedish
sv · ISO swe
15
1
150,988,092
Ukrainian
uk · ISO ukr
15
1
115,321,115
Persian
fa · ISO fas
14
1
79,974,247
Hindi
hi · ISO hin
14
1
201,676,281
Malay (macrolanguage)
ms · ISO msa
14
1
66,676,891
Estonian
et · ISO est
13
1
47,066,682
Hebrew
he · ISO heb
13
1
57,688,894
Croatian
hr · ISO hrv
13
1
98,390,596
Albanian
sq · ISO sqi
13
1
30,819,696
Armenian
hy · ISO hye
12
1
15,144,422
Javanese
jv · ISO jav
12
1
4,362,990
Korean
ko · ISO kor
12
1
93,976,533
Latvian
lv · ISO lav
12
1
60,558,447
Tamil
ta · ISO tam
12
1
22,544,852
Bengali
bn · ISO ben
11
1
72,193,532
Georgian
ka · ISO kat
11
1
16,673,674
Urdu
ur · ISO urd
11
1
24,429,098
Azerbaijani
az · ISO aze
10
1
12,320,555
Welsh
cy · ISO cym
10
1
11,957,225
Macedonian
mk · ISO mkd
10
1
25,041,459
Marathi
mr · ISO mar
10
1
14,646,936
Slovak
sk · ISO slk
10
1
82,202,228
Serbian
sr · ISO srp
10
1
37,759,007
Swahili (macrolanguage)
sw · ISO swa
10
1
18,870,930
Afrikaans
af · ISO afr
9
1
25,524,380
Amharic
am · ISO amh
9
1
5,031,507
Icelandic
is · ISO isl
9
1
18,330,387
Khmer
km · ISO khm
9
1
6,580,869
Kannada
kn · ISO kan
9
1
2,517,877
Slovenian
sl · ISO slv
9
1
56,178,513
Belarusian
be · ISO bel
8
1
19,846,574
Breton
br · ISO bre
8
1
829,878
Gujarati
gu · ISO guj
8
1
2,853,478
Hausa
ha · ISO hau
8
1
3,546,788
Lao
lo · ISO lao
8
1
1,205,464
Telugu
te · ISO tel
8
1
11,225,177
Haitian
ht · ISO hat
7
1
8,890,530
Panjabi
pa · ISO pan
7
1
2,772,171
Sinhala
si · ISO sin
7
1
12,699,200
Somali
so · ISO som
7
1
3,087,972
Sundanese
su · ISO sun
7
1
5,148,042
Tajik
tg · ISO tgk
7
1
3,479,404
Zulu
zu · ISO zul
7
1
1,457,574
cb
cb
6
1
319,949
Fulah
ff · ISO ful
6
1
458,052
Igbo
ig · ISO ibo
6
1
2,558,857
Kirghiz
ky · ISO kir
6
1
3,021,141
Malagasy
mg · ISO mlg
6
1
6,575,120
Mongolian
mn · ISO mon
6
1
5,459,950
Nepali (macrolanguage)
ne · ISO nep
6
1
9,591,800
Pushto
ps · ISO pus
6
1
3,994,320
Xhosa
xh · ISO xho
6
1
1,491,771
Assamese
as · ISO asm
5
1
295,118
Bosnian
bs · ISO bos
5
1
6,044,169
Kurdish
ku · ISO kur
5
1
2,681,541
Malayalam
ml · ISO mal
5
1
14,919,809
ns
ns
5
1
97,405
Chichewa
ny · ISO nya
5
1
1,947,569
Tswana
tn · ISO tsn
5
1
263,679
Wolof
wo · ISO wol
5
1
441,928
Yoruba
yo · ISO yor
5
1
3,332,139
Lingala
ln · ISO lin
4
1
89,630
Maori
mi · ISO mri
4
1
2,331,263
qd
qd
4
1
3,699
Tigrinya
ti · ISO tir
4
1
146,972
Oromo
om · ISO orm
3
1
96,819
Oriya (macrolanguage)
or · ISO ori
3
1
94,378
Shona
sn · ISO sna
3
1
1,395,427
Swati
ss · ISO ssw
3
1
90,020
Tsonga
ts · ISO tso
2
1
31,941
Venda
ve · ISO ven
1
1
27,159
Download the 2026-08-01 snapshot CSV ↓