Moses-support Digest, Vol 143, Issue 2

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: terminate called after throwing an instance, of
'util::FDException' (Tom Hoar)
2. Re: terminate called after throwing an instance of
'util::FDException' (Hieu Hoang)


----------------------------------------------------------------------

Message: 1
Date: Sun, 2 Sep 2018 10:42:46 +0700
From: Tom Hoar <tahoar@slate.rocks>
Subject: Re: [Moses-support] terminate called after throwing an
instance, of 'util::FDException'
To: moses-support@mit.edu
Message-ID: <3fb87a6e-1d0d-756c-c457-3d7e5ddfc96c@slate.rocks>
Content-Type: text/plain; charset="utf-8"

Arezoo,

Rerun your `train-model.perl` and `mert-moses.pl` commands with
fully-resolved paths.


Best regards,
Tom Hoar
*Slate Rocks, LLC*
Web: https://www.slate.rocks
Thailand Mobile: +66 87 345-1875 <tel:+66873451875>
Skype: tahoar <skype:tahoar?call>


On 9/1/2018 11:00 PM, moses-support-request@mit.edu wrote:
> Date: Sat, 1 Sep 2018 09:20:02 +0000 (UTC)
> From: Arezoo Arjomand<arezooarjomand@yahoo.com>
> Subject: [Moses-support] terminate called after throwing an instance
> of 'util::FDException'
> To:"moses-support-owner@mit.edu" <moses-support-owner@mit.edu>,
> "moses-support-request@mit.edu" <moses-support-request@mit.edu>,
> Moses-support<moses-support@mit.edu>
> Message-ID:<267593527.1838169.1535793602213@mail.yahoo.com>
> Content-Type: text/plain; charset="utf-8"
>
> Hi all,
> I? run??? the??? following??? command??? to??? tune??? rule-table??? but??? the? error??? is?? appeared.???
> thank??? you??
>
> error:
> Using SCRIPTS_ROOTDIR: /home/arezoo1/mosesdecoder-master/mosesdecoder-master/scripts
> Assuming --mertdir=/home/arezoo1/mosesdecoder-master/mosesdecoder-master/bin
> Using cached features list: ./features.list
> MERT starting values and ranges for random generation:
> ? WordPenalty0 =? -1.000 ( 0.00 ..? 1.00)
> ? PhrasePenalty0 =?? 0.200 ( 0.00 ..? 1.00)
> ? TranslationModel0 =?? 0.200 ( 0.00 ..? 1.00)
> ? TranslationModel0 =?? 0.200 ( 0.00 ..? 1.00)
> ? TranslationModel0 =?? 0.200 ( 0.00 ..? 1.00)
> ? TranslationModel0 =?? 0.200 ( 0.00 ..? 1.00)
> ? TranslationModel1 =?? 1.000 ( 0.00 ..? 1.00)
> ??? LM0 =?? 0.500 ( 0.00 ..? 1.00)
> featlist: WordPenalty0=-1
> featlist: PhrasePenalty0=0.2
> featlist: TranslationModel0=0.2
> featlist: TranslationModel0=0.2
> featlist: TranslationModel0=0.2
> featlist: TranslationModel0=0.2
> featlist: TranslationModel1=1
> featlist: LM0=0.5
> run 1 start at Sat Sep? 1 04:57:35 EDT 2018
> Parsing --decoder-flags: |-v 0|
> Saving new config to: ./run1.moses.ini
> Saved: ./run1.moses.ini
> Normalizing lambdas: -1 0.2 0.2 0.2 0.2 0.2 1 0.5
> DECODER_CFG = -weight-overwrite 'LM0= 0.142857 PhrasePenalty0= 0.057143 WordPenalty0= -0.285714 TranslationModel0= 0.057143 0.057143 0.057143 0.057143 TranslationModel1= 0.285714'
> Executing: /home/arezoo1/mosesdecoder-master/mosesdecoder-master/bin/moses2 -v 0? -config /home/arezoo1/emlla/train/model/moses.ini -inputtype 3 -weight-overwrite 'LM0= 0.142857 PhrasePenalty0= 0.057143 WordPenalty0= -0.285714 TranslationModel0= 0.057143 0.057143 0.057143 0.057143 TranslationModel1= 0.285714'? -n-best-list run1.best100.out 100 distinct? -input-file /home/arezoo1/emlla/nc-dev2007.true.fr > run1.out
> Executing: /home/arezoo1/mosesdecoder-master/mosesdecoder-master/bin/moses2 -v 0? -config /home/arezoo1/emlla/train/model/moses.ini -inputtype 3 -weight-overwrite 'LM0= 0.142857 PhrasePenalty0= 0.057143 WordPenalty0= -0.285714 TranslationModel0= 0.057143 0.057143 0.057143 0.057143 TranslationModel1= 0.285714'? -n-best-list run1.best100.out 100 distinct? -input-file /home/arezoo1/emlla/nc-dev2007.true.fr > run1.out
> 1-10.20.2 0.2 0.2 0.210.5(1) run decoder to produce n-best lists
> params = -v 0
> decoder_config = -weight-overwrite 'LM0= 0.142857 PhrasePenalty0= 0.057143 WordPenalty0= -0.285714 TranslationModel0= 0.057143 0.057143 0.057143 0.057143 TranslationModel1= 0.285714'
> Starting...
> START featureFunctions.Load()
> Loading WordPenalty0
> Finished loading WordPenalty0
> Loading PhrasePenalty0
> Finished loading PhrasePenalty0
> Loading LM0
> terminate called after throwing an instance of 'util::FDException'
> ? what():? util/file.cc:175 in std::size_t util::PartialRead(int, void*, std::size_t) threw FDException because `ret < 0'.
> Is a directory in /home/arezoo1/emlla while reading 6 bytes in file /home/arezoo1/emlla
> Aborted (core dumped)
> Exit code: 134
> The decoder died. CONFIG WAS -weight-overwrite 'LM0= 0.142857 PhrasePenalty0= 0.057143 WordPenalty0= -0.285714 TranslationModel0= 0.057143 0.057143 0.057143 0.057143 TranslationModel1= 0.285714'
>
>
>
> train:
>
> /home/arezoo1/mosesdecoder-master/mosesdecoder-master/scripts/training/train-model.perl \
> -root-dir train \
> -corpus /home/arezoo1/emlla/news-commentary-v8.fr-en.clean \
> -f fr -e en -alignment grow-diag-final-and -hierarchical -glue-grammar \ -lm 0:3:/home/arezoo1/emlla/news-commentary-v8.fr-en.blm.en \
> -mgiza -mgiza-cpus 4 \
> -external-bin-dir /home/arezoo1/mosesdecoder-master/mosesdecoder-master/tools >&training2.out
>
>
> tune:
> /home/arezoo1/mosesdecoder-master/mosesdecoder-master/scripts/training/mert-moses.pl? /home/arezoo1/emlla/nc-dev2007.true.fr /home/arezoo1/emlla/nc-dev2007.true.en? /home/arezoo1/mosesdecoder-master/mosesdecoder-master/bin/moses2? /home/arezoo1/emlla/train/model/moses.ini? --rootdir /home/arezoo1/mosesdecoder-master/mosesdecoder-master/scripts --decoder-flags "-v 0"? --no-filter-phrase-table --inputtype 3? --batch-mira? --return-best-dev --filtercmd '/home/arezoo1/mosesdecoder-master/mosesdecoder-master/scripts/training/filter-model-given-input.pl'? --batch-mira-args '-J 300' 1>&mert.out
>
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL:http://mailman.mit.edu/mailman/private/moses-support/attachments/20180901/1c38b93e/attachment-0001.html
>
> ------------------------------

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20180901/0d2d12d8/attachment-0001.html

------------------------------

Message: 2
Date: Sun, 2 Sep 2018 11:23:52 +0100
From: Hieu Hoang <hieuhoang@gmail.com>
Subject: Re: [Moses-support] terminate called after throwing an
instance of 'util::FDException'
To: Arezoo Arjomand <arezooarjomand@yahoo.com>
Cc: moses-support <moses-support@mit.edu>,
moses-support-request@mit.edu, moses-support-owner@mit.edu
Message-ID:
<CAEKMkbhvFVJTTWghMdBwA7cR5QLsJFnz96OqNXROto=4F_bNJA@mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

can you please let me see the file
/home/arezoo1/emlla/train/model/moses.ini

Hieu Hoang
http://statmt.org/hieu


On Sat, 1 Sep 2018 at 10:24, Arezoo Arjomand <arezooarjomand@yahoo.com>
wrote:

> Hi all,
> I run the following command to tune rule-table
> but the error is appeared.
> thank you
>
> error:
> Using SCRIPTS_ROOTDIR:
> /home/arezoo1/mosesdecoder-master/mosesdecoder-master/scripts
> Assuming
> --mertdir=/home/arezoo1/mosesdecoder-master/mosesdecoder-master/bin
> Using cached features list: ./features.list
> MERT starting values and ranges for random generation:
> WordPenalty0 = -1.000 ( 0.00 .. 1.00)
> PhrasePenalty0 = 0.200 ( 0.00 .. 1.00)
> TranslationModel0 = 0.200 ( 0.00 .. 1.00)
> TranslationModel0 = 0.200 ( 0.00 .. 1.00)
> TranslationModel0 = 0.200 ( 0.00 .. 1.00)
> TranslationModel0 = 0.200 ( 0.00 .. 1.00)
> TranslationModel1 = 1.000 ( 0.00 .. 1.00)
> LM0 = 0.500 ( 0.00 .. 1.00)
> featlist: WordPenalty0=-1
> featlist: PhrasePenalty0=0.2
> featlist: TranslationModel0=0.2
> featlist: TranslationModel0=0.2
> featlist: TranslationModel0=0.2
> featlist: TranslationModel0=0.2
> featlist: TranslationModel1=1
> featlist: LM0=0.5
> run 1 start at Sat Sep 1 04:57:35 EDT 2018
> Parsing --decoder-flags: |-v 0|
> Saving new config to: ./run1.moses.ini
> Saved: ./run1.moses.ini
> Normalizing lambdas: -1 0.2 0.2 0.2 0.2 0.2 1 0.5
> DECODER_CFG = -weight-overwrite 'LM0= 0.142857 PhrasePenalty0= 0.057143
> WordPenalty0= -0.285714 TranslationModel0= 0.057143 0.057143 0.057143
> 0.057143 TranslationModel1= 0.285714'
> Executing:
> /home/arezoo1/mosesdecoder-master/mosesdecoder-master/bin/moses2 -v 0
> -config /home/arezoo1/emlla/train/model/moses.ini -inputtype 3
> -weight-overwrite 'LM0= 0.142857 PhrasePenalty0= 0.057143 WordPenalty0=
> -0.285714 TranslationModel0= 0.057143 0.057143 0.057143 0.057143
> TranslationModel1= 0.285714' -n-best-list run1.best100.out 100 distinct
> -input-file /home/arezoo1/emlla/nc-dev2007.true.fr > run1.out
> Executing:
> /home/arezoo1/mosesdecoder-master/mosesdecoder-master/bin/moses2 -v 0
> -config /home/arezoo1/emlla/train/model/moses.ini -inputtype 3
> -weight-overwrite 'LM0= 0.142857 PhrasePenalty0= 0.057143 WordPenalty0=
> -0.285714 TranslationModel0= 0.057143 0.057143 0.057143 0.057143
> TranslationModel1= 0.285714' -n-best-list run1.best100.out 100 distinct
> -input-file /home/arezoo1/emlla/nc-dev2007.true.fr > run1.out
> 1-10.20.2 0.2 0.2 0.210.5(1) run decoder to produce n-best lists
> params = -v 0
> decoder_config = -weight-overwrite 'LM0= 0.142857 PhrasePenalty0= 0.057143
> WordPenalty0= -0.285714 TranslationModel0= 0.057143 0.057143 0.057143
> 0.057143 TranslationModel1= 0.285714'
> Starting...
> START featureFunctions.Load()
> Loading WordPenalty0
> Finished loading WordPenalty0
> Loading PhrasePenalty0
> Finished loading PhrasePenalty0
> Loading LM0
> terminate called after throwing an instance of 'util::FDException'
> what(): util/file.cc:175 in std::size_t util::PartialRead(int, void*,
> std::size_t) threw FDException because `ret < 0'.
> Is a directory in /home/arezoo1/emlla while reading 6 bytes in file
> /home/arezoo1/emlla
> Aborted (core dumped)
> Exit code: 134
> The decoder died. CONFIG WAS -weight-overwrite 'LM0= 0.142857
> PhrasePenalty0= 0.057143 WordPenalty0= -0.285714 TranslationModel0=
> 0.057143 0.057143 0.057143 0.057143 TranslationModel1= 0.285714'
>
>
>
> train:
>
> /home/arezoo1/mosesdecoder-master/mosesdecoder-master/scripts/training/train-model.perl
> \
>
> -root-dir train \-corpus /home/arezoo1/emlla/news-commentary-v8.fr-en.clean \-f fr -e en -alignment grow-diag-final-and -hierarchical -glue-grammar \ -lm 0:3:/home/arezoo1/emlla/news-commentary-v8.fr-en.blm.en \-mgiza -mgiza-cpus 4 \*-external-bin-dir */home/arezoo1/mosesdecoder-master/mosesdecoder-master*/tools >&training2.out*
>
>
>
>
> tune:
> /home/arezoo1/mosesdecoder-master/mosesdecoder-master/scripts/training/
> mert-moses.pl /home/arezoo1/emlla/nc-dev2007.true.fr
> /home/arezoo1/emlla/nc-dev2007.true.en
> /home/arezoo1/mosesdecoder-master/mosesdecoder-master/bin/moses2
> /home/arezoo1/emlla/train/model/moses.ini --rootdir
> /home/arezoo1/mosesdecoder-master/mosesdecoder-master/scripts
> --decoder-flags "-v 0" --no-filter-phrase-table --inputtype 3
> --batch-mira --return-best-dev --filtercmd
> '/home/arezoo1/mosesdecoder-master/mosesdecoder-master/scripts/training/
> filter-model-given-input.pl' --batch-mira-args '-J 300' 1>&mert.out
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20180902/ceb8742a/attachment.html

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 143, Issue 2
*********************************************

Tweet