Home » Uncategories » Moses-support Digest, Vol 135, Issue 5

Moses-support Digest, Vol 135, Issue 5

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. dyld: Library not loaded: libboost_thread.dylib (Kelly Marchisio)
2. Re: dyld: Library not loaded: libboost_thread.dylib (Hieu Hoang)
3. Re: Some Noob Questions (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Sun, 7 Jan 2018 14:12:34 -0500
From: Kelly Marchisio <kellymarchisio@gmail.com>
Subject: [Moses-support] dyld: Library not loaded:
libboost_thread.dylib
To: moses-support@mit.edu
Message-ID:
<CA++YajmLThtPKNJs+gpcNN7oLZ8QWATA34VZMA73VOLjA2O+mg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi There,

I am following the Baseline system guide, 'Training the translation system'
section.

I run:


nohup nice -n 10
/Users/kellymarchisio/L101Final/programs/mosesdecoder/scripts/training/train-model.perl
-root-dir train -corpus
/Users/kellymarchisio/L101Final/programs/corpus/news-commentary-v8.fr-en-SHORT.clean
-f fr -e en -alignment grow-diag-final-and -reordering msd-bidirectional-fe
-lm
0:3:/Users/kellymarchisio/L101Final/programs/lm/news-commentary-v8.fr-en.blm.en:8
-external-bin-dir
/Users/kellymarchisio/L101Final/programs/mosesdecoder/tools/ -cores 8 >&
training.out &


But receive the following error

Executing: rm -f
/Users/kellymarchisio/L101Final/programs/working/train/giza.en-fr/en-fr.A3.final.gz
Executing: gzip
/Users/kellymarchisio/L101Final/programs/working/train/giza.en-fr/en-fr.A3.final
(3) generate word alignment @ Sun Jan 7 13:22:48 EST 2018
Combining forward and inverted alignment from files:

/Users/kellymarchisio/L101Final/programs/working/train/giza.fr-en/fr-en.A3.final.{bz2,gz}

/Users/kellymarchisio/L101Final/programs/working/train/giza.en-fr/en-fr.A3.final.{bz2,gz}
Executing: mkdir -p
/Users/kellymarchisio/L101Final/programs/working/train/model
Executing:
/Users/kellymarchisio/L101Final/programs/mosesdecoder/scripts/training/
giza2bal.pl -d "gzip -cd
/Users/kellymarchisio/L101Final/programs/working/train/giza.en-fr/en-fr.A3.final.gz"
-i "gzip -cd
/Users/kellymarchisio/L101Final/programs/working/train/giza.fr-en/fr-en.A3.final.gz"
|/Users/kellymarchisio/L101Final/programs/mosesdecoder/scripts/../bin/symal
-alignment="grow" -diagonal="yes" -final="yes" -both="yes" >
/Users/kellymarchisio/L101Final/programs/working/train/model/aligned.grow-diag-final-and
dyld: Library not loaded: libboost_thread.dylib
Referenced from:
/Users/kellymarchisio/L101Final/programs/mosesdecoder/scripts/../bin/symal
Reason: image not found
sh: line 1: 53122 Broken pipe: 13
/Users/kellymarchisio/L101Final/programs/mosesdecoder/scripts/training/
giza2bal.pl -d "gzip -cd
/Users/kellymarchisio/L101Final/programs/working/train/giza.en-fr/en-fr.A3.final.gz"
-i "gzip -cd
/Users/kellymarchisio/L101Final/programs/working/train/giza.fr-en/fr-en.A3.final.gz"
53123 Abort trap: 6 |
/Users/kellymarchisio/L101Final/programs/mosesdecoder/scripts/../bin/symal
-alignment="grow" -diagonal="yes" -final="yes" -both="yes" >
/Users/kellymarchisio/L101Final/programs/working/train/model/aligned.grow-diag-final-and
Exit code: 134
ERROR: Can't generate symmetrized alignment file


Does anyone know why the script is unable to find libboost_thread.dylib,
and how I can fix?

Thanks,
Kelly
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20180107/70b09c48/attachment-0001.html

------------------------------

Message: 2
Date: Sun, 7 Jan 2018 20:04:15 +0000
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] dyld: Library not loaded:
libboost_thread.dylib
To: Kelly Marchisio <kellymarchisio@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbg-EihRnKp9gfQ7eFinAJX2KVFEUduvs7Kd9BCUSdF0Yg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

what is the exact command you used to compile moses? Did you compile boost
yourself or was it installed by a package manager?

If the boost library is not in the default directory, you have to tell the
program where they are by setting the environment variable LD_LIBRARY_PATH
or DYLD_LIBRARY_PATH


Hieu Hoang
http://moses-smt.org/


On 7 January 2018 at 19:12, Kelly Marchisio <kellymarchisio@gmail.com>
wrote:

> Hi There,
>
> I am following the Baseline system guide, 'Training the translation
> system' section.
>
> I run:
>
>
> nohup nice -n 10 /Users/kellymarchisio/L101Final/programs/
> mosesdecoder/scripts/training/train-model.perl -root-dir train -corpus
> /Users/kellymarchisio/L101Final/programs/corpus/news-commentary-v8.fr-en-SHORT.clean
> -f fr -e en -alignment grow-diag-final-and -reordering msd-bidirectional-fe
> -lm 0:3:/Users/kellymarchisio/L101Final/programs/lm/news-commentary-v8.fr-en.blm.en:8
> -external-bin-dir /Users/kellymarchisio/L101Final/programs/mosesdecoder/tools/
> -cores 8 >& training.out &
>
>
> But receive the following error
>
> Executing: rm -f /Users/kellymarchisio/L101Final/programs/working/
> train/giza.en-fr/en-fr.A3.final.gz
> Executing: gzip /Users/kellymarchisio/L101Final/programs/working/
> train/giza.en-fr/en-fr.A3.final
> (3) generate word alignment @ Sun Jan 7 13:22:48 EST 2018
> Combining forward and inverted alignment from files:
> /Users/kellymarchisio/L101Final/programs/working/
> train/giza.fr-en/fr-en.A3.final.{bz2,gz}
> /Users/kellymarchisio/L101Final/programs/working/
> train/giza.en-fr/en-fr.A3.final.{bz2,gz}
> Executing: mkdir -p /Users/kellymarchisio/L101Final/programs/working/
> train/model
> Executing: /Users/kellymarchisio/L101Final/programs/
> mosesdecoder/scripts/training/giza2bal.pl -d "gzip -cd
> /Users/kellymarchisio/L101Final/programs/working/
> train/giza.en-fr/en-fr.A3.final.gz" -i "gzip -cd /Users/kellymarchisio/
> L101Final/programs/working/train/giza.fr-en/fr-en.A3.final.gz"
> |/Users/kellymarchisio/L101Final/programs/mosesdecoder/scripts/../bin/symal
> -alignment="grow" -diagonal="yes" -final="yes" -both="yes" >
> /Users/kellymarchisio/L101Final/programs/working/
> train/model/aligned.grow-diag-final-and
> dyld: Library not loaded: libboost_thread.dylib
> Referenced from: /Users/kellymarchisio/L101Final/programs/
> mosesdecoder/scripts/../bin/symal
> Reason: image not found
> sh: line 1: 53122 Broken pipe: 13 /Users/kellymarchisio/
> L101Final/programs/mosesdecoder/scripts/training/giza2bal.pl -d "gzip -cd
> /Users/kellymarchisio/L101Final/programs/working/
> train/giza.en-fr/en-fr.A3.final.gz" -i "gzip -cd /Users/kellymarchisio/
> L101Final/programs/working/train/giza.fr-en/fr-en.A3.final.gz"
> 53123 Abort trap: 6 | /Users/kellymarchisio/
> L101Final/programs/mosesdecoder/scripts/../bin/symal -alignment="grow"
> -diagonal="yes" -final="yes" -both="yes" > /Users/kellymarchisio/
> L101Final/programs/working/train/model/aligned.grow-diag-final-and
> Exit code: 134
> ERROR: Can't generate symmetrized alignment file
>
>
> Does anyone know why the script is unable to find libboost_thread.dylib,
> and how I can fix?
>
> Thanks,
> Kelly
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20180107/cab4095b/attachment-0001.html

------------------------------

Message: 3
Date: Sun, 7 Jan 2018 20:11:04 +0000
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] Some Noob Questions
To: Jesvir Zuniega <engineerkuno@gmail.com>
Cc: moses-support <moses-support@mit.edu>
Message-ID:
<CAEKMkbiPrhKxxNhQqxszHp_qe4eEx47bsf0-rEYLs+-0QuQixg@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hieu Hoang
http://moses-smt.org/


On 7 January 2018 at 02:09, Jesvir Zuniega <engineerkuno@gmail.com> wrote:

> Hi, I am pretty new in Moses SMT and in the field of NLP.
> I've successfully trained two translators for Bikol (ISO 639-3 bcl
> <http://www-01.sil.org/iso639-3/documentation.asp?id=bcl>) to English and
> an English to Bikol. Evaluation for both translators resulted to decent
> BLEU scores which is around 33.0 with parameters (ie. -mbr -mp -s) but
> without additional pre-processing techniques like (POS tagging,
> morphological analysis, etc...).
> And my questions are:
>
> 1. Does training an Unsupervised Transliteration Model could help to
> improve the translation quality involving a language (Bikol) that consist
> of alphanumeric characters only?
>
transliteration is usually used if you need to translate proper nouns which
are not in your parallel corpus. So if you have lots of untranslated names
etc in your output, then it would be worthwhile to look into it.

2. What are the other pre-processing techniques that does not require a
> lexicon (Dictionary)? I am having difficulties to find a good source of
> Bikol lexicons because of its unpopularity.
>
better tokenization, word error correction or normalization would be good
start

3. Is it possible to train a translation model with a POS tagged corpus as
> a source language to a target language which corpus is not POS tagged or
> vice versa?
>
Not sure what you mean. Try it and see

>
> Thank you. :)
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20180107/ab01d8cb/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 135, Issue 5
*********************************************

0 Response to "Moses-support Digest, Vol 135, Issue 5"

Post a Comment

Subscribe to: Post Comments (Atom)