Moses-support Digest, Vol 103, Issue 20

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Problem with qsub when running experiments (Barry Haddow)
2. Re: Problem with qsub when running experiments
(carla.parra@hermestrans.com)


----------------------------------------------------------------------

Message: 1
Date: Wed, 06 May 2015 14:27:57 +0100
From: Barry Haddow <bhaddow@staffmail.ed.ac.uk>
Subject: Re: [Moses-support] Problem with qsub when running
experiments
To: carla.parra@hermestrans.com, moses-support <moses-support@mit.edu>
Message-ID: <554A16DD.7000901@staffmail.ed.ac.uk>
Content-Type: text/plain; charset=utf-8; format=flowed

Hi Carla

Not sure what's going on, and no reason why things should change when
you installed asiya. Something else must have changed.

Could you post your EMS config file, and the exact command you use to
run EMS?

cheers - Barry

On 06/05/15 13:32, carla.parra@hermestrans.com wrote:
> Hi Barry,
>
> thanks for your prompt reply. If I am not wrong the name of the server
> is "hermesta-Z10PE-D8-WS" (I have taken it from the machine
> information, I attach a screenshot). If I should look somewhere else
> please let me know.
>
> Thanks,
> Carla
>
> El 06.05.2015 14:10, Barry Haddow escribi?:
>> Hi Carla
>>
>> What's your server called?
>>
>> There's a hard-coded list of Edinburgh machines in ems, so I'm
>> wondering if it collides with one of them,
>>
>> cheers - Barry
>>
>> On 06/05/15 12:56, carla.parra@hermestrans.com wrote:
>>> Hi everyone,
>>>
>>> First of all, thanks for reading and hopefully giving me some useful
>>> pointer. I am running several SMT experiments on an Ubuntu machine. It
>>> is a multicore machine, but I have commented out the options for
>>> running
>>> experiments on multicore machines in the config.file.
>>>
>>> Up to last week, I was able to run experiments without problems.
>>> However, since yesterday I get the error:
>>>
>>> "Can't exec "qsub": No existe el archivo o el directorio at
>>> /home/hermesta/mosesdecoder/scripts/ems/experiment.perl line 1291."
>>>
>>> Does anyone know what could be going on? The only thing I did was
>>> installing asiya to assess MT output. My guess is that somehow MOSES
>>> detects that it is a multicore machine and tries to parallelize jobs.
>>> However, I don't understand why this was not happening last week, for
>>> instance. I have also tried to update MOSES by running "git pull" and I
>>> also reinstalled MOSES hoping this would fix the problem. My background
>>> is linguistics, and thus I am a bit lost now.
>>>
>>> Thank you very much,
>>>
>>> Carla Parra Escart?n
>>> Marie Curie ER - EXPERT ITN
>>> Hermes Traducciones
>>>
>>>
>>> _______________________________________________
>>> Moses-support mailing list
>>> Moses-support@mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/moses-support


--
The University of Edinburgh is a charitable body, registered in
Scotland, with registration number SC005336.



------------------------------

Message: 2
Date: Wed, 06 May 2015 15:59:20 +0200
From: carla.parra@hermestrans.com
Subject: Re: [Moses-support] Problem with qsub when running
experiments
To: moses-support <moses-support@mit.edu>
Message-ID: <e04bcd84476a2f24977049efd9efcbe6@hermestrans.com>
Content-Type: text/plain; charset="utf-8"

Hi again,

this is the command I use: "~/mosesdecoder/scripts/ems/experiment.perl
-config config.toy -exec"

I have also tried a modification of the configuration file
"config.placeables". This is when the problem started. To make sure that
it was not the config file, I tried with an older config.file from
another experiment which finished without problems (just changed the
path for the experiment). I tried to run an older experiment which
worked and also failed this time with the same error.

I attach both files, so that you can see them.

I don't know if it might help, but I also tried to run the experiment
step-by-step and at decoding I also got an error:

/home/hermesta/mosesdecoder/scripts/training/mert-moses.pl
/home/hermesta/Exps/KES_newDev_placeholders/data/dev/KES10.dev.preproc.tok.true.en
/home/hermesta/Exps/KES_newDev_placeholders/data/dev/KES10.dev.preproc.tok.true.es
/home/hermesta/mosesdecoder/bin/moses
/home/hermesta/Exps/KES_newDev_placeholders/working/train/model/moses.ini
--mertdir /home/hermesta/mosesdecoder/bin/

Using SCRIPTS_ROOTDIR: /home/hermesta/mosesdecoder/scripts
filtering the phrase tables... mi? may 6 15:58:15 CEST 2015
exec:
/home/hermesta/mosesdecoder/scripts/training/filter-model-given-input.pl
./filtered
/home/hermesta/Exps/KES_newDev_placeholders/working/train/model/moses.ini
/home/hermesta/Exps/KES_newDev_placeholders/data/dev/KES10.dev.preproc.tok.true.en
Executing:
/home/hermesta/mosesdecoder/scripts/training/filter-model-given-input.pl
./filtered
/home/hermesta/Exps/KES_newDev_placeholders/working/train/model/moses.ini
/home/hermesta/Exps/KES_newDev_placeholders/data/dev/KES10.dev.preproc.tok.true.en
> filterphrases.out 2> filterphrases.err
Exit code: 1
ERROR: Failed to run
'/home/hermesta/mosesdecoder/scripts/training/filter-model-given-input.pl
./filtered
/home/hermesta/Exps/KES_newDev_placeholders/working/train/model/moses.ini
/home/hermesta/Exps/KES_newDev_placeholders/data/dev/KES10.dev.preproc.tok.true.en'.
at /home/hermesta/mosesdecoder/scripts/training/mert-moses.pl line 1719.

When checking line 1719 of mert-moses.pl, I realized it is also related
to qsub.

Thank you so much!
Carla

El 06.05.2015 15:27, Barry Haddow escribi?:
> Hi Carla
>
> Not sure what's going on, and no reason why things should change when
> you installed asiya. Something else must have changed.
>
> Could you post your EMS config file, and the exact command you use to
> run EMS?
>
> cheers - Barry
>
> On 06/05/15 13:32, carla.parra@hermestrans.com wrote:
>> Hi Barry,
>>
>> thanks for your prompt reply. If I am not wrong the name of the server
>> is "hermesta-Z10PE-D8-WS" (I have taken it from the machine
>> information, I attach a screenshot). If I should look somewhere else
>> please let me know.
>>
>> Thanks,
>> Carla
>>
>> El 06.05.2015 14:10, Barry Haddow escribi?:
>>> Hi Carla
>>>
>>> What's your server called?
>>>
>>> There's a hard-coded list of Edinburgh machines in ems, so I'm
>>> wondering if it collides with one of them,
>>>
>>> cheers - Barry
>>>
>>> On 06/05/15 12:56, carla.parra@hermestrans.com wrote:
>>>> Hi everyone,
>>>>
>>>> First of all, thanks for reading and hopefully giving me some useful
>>>> pointer. I am running several SMT experiments on an Ubuntu machine.
>>>> It
>>>> is a multicore machine, but I have commented out the options for
>>>> running
>>>> experiments on multicore machines in the config.file.
>>>>
>>>> Up to last week, I was able to run experiments without problems.
>>>> However, since yesterday I get the error:
>>>>
>>>> "Can't exec "qsub": No existe el archivo o el directorio at
>>>> /home/hermesta/mosesdecoder/scripts/ems/experiment.perl line 1291."
>>>>
>>>> Does anyone know what could be going on? The only thing I did was
>>>> installing asiya to assess MT output. My guess is that somehow MOSES
>>>> detects that it is a multicore machine and tries to parallelize
>>>> jobs.
>>>> However, I don't understand why this was not happening last week,
>>>> for
>>>> instance. I have also tried to update MOSES by running "git pull"
>>>> and I
>>>> also reinstalled MOSES hoping this would fix the problem. My
>>>> background
>>>> is linguistics, and thus I am a bit lost now.
>>>>
>>>> Thank you very much,
>>>>
>>>> Carla Parra Escart?n
>>>> Marie Curie ER - EXPERT ITN
>>>> Hermes Traducciones
>>>>
>>>>
>>>> _______________________________________________
>>>> Moses-support mailing list
>>>> Moses-support@mit.edu
>>>> http://mailman.mit.edu/mailman/listinfo/moses-support
-------------- next part --------------
A non-text attachment was scrubbed...
Name: config.placeables
Type: text/x-c
Size: 20016 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20150506/e7302901/attachment.bin
-------------- next part --------------
A non-text attachment was scrubbed...
Name: config.toy
Type: text/x-c
Size: 20878 bytes
Desc: not available
Url : http://mailman.mit.edu/mailman/private/moses-support/attachments/20150506/e7302901/attachment-0001.bin

------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 103, Issue 20
**********************************************

Tweet