mira/bertalign
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
bfsujason
2021-05-18 02:47:43 +08:00
committed by GitHub
parent 78fae69bf1
commit 00a9467390
1 changed files with 2 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
README.md
View File

@@ -3,9 +3,7 @@ Word Embedding-Based Bilingual Sentence Aligner
## Evaluation Corpus ## Evaluation Corpus
This section describes the procedure of creating the evaluation corpora: the manually aligned corpus (MAC) of Chinese-English literary texts and the Bible corpus aligned at the verse level. This section describes the procedure of creating the evaluation corpora: the manually aligned corpus (MAC) of Chinese-English literary texts and the Bible corpus aligned at the verse level.
### MAC ### MAC-Test
Firstly, 5 chapters and their translations are sampled from each of the 6 novels included in MAC, obtaining a corpus of 30 bitexts. We then split the corpus into MAC-Dev and MAC-Test with the former containing 6 chapters and the latter 24 chapters.
The **MAC-Test** is saved in [corpus/mac/test](./corpus/mac/test) The **MAC-Test** is saved in [corpus/mac/test](./corpus/mac/test)
The sampling schemes for building MAC-Test can be found at [meta_data.tsv](./corpus/mac/test/meta_data.tsv) The sampling schemes for building MAC-Test can be found at [meta_data.tsv](./corpus/mac/test/meta_data.tsv)
@@ -23,7 +21,7 @@ We use [Intertext](https://wanthalf.saga.cz/intertext) to perform the manual ali
In order to facilitate system evaluations, we delete the XML tags and save the clean gold alignment file with only sentence IDs in the [gold](./eval/mac/test/gold) directory In order to facilitate system evaluations, we delete the XML tags and save the clean gold alignment file with only sentence IDs in the [gold](./eval/mac/test/gold) directory
### Bible ### Bible
The Bible corpus is located in [corpus/bible](./corpus/bible) The **Bible** corpus is located in [corpus/bible](./corpus/bible)
The directory makeup is similar to MAC, except that there is no *intertext* directory for manual alignments. The directory makeup is similar to MAC, except that there is no *intertext* directory for manual alignments.