Moses-support Digest, Vol 88, Issue 3

Send Moses-support mailing list submissions to
moses-support@mit.edu

To subscribe or unsubscribe via the World Wide Web, visit
http://mailman.mit.edu/mailman/listinfo/moses-support
or, via email, send a message with subject or body 'help' to
moses-support-request@mit.edu

You can reach the person managing the list at
moses-support-owner@mit.edu

When replying, please edit your Subject line so it is more specific
than "Re: Contents of Moses-support digest..."


Today's Topics:

1. Re: Building problem (Lane Schwartz)
2. Re: Building problem (Tom Hoar)
3. Re: Building problem (Prashant Mathur)
4. Re: Building problem (Lane Schwartz)


----------------------------------------------------------------------

Message: 1
Date: Mon, 3 Feb 2014 14:41:20 +0000
From: Lane Schwartz <dowobeha@gmail.com>
Subject: Re: [Moses-support] Building problem
To: Tom Hoar <tahoar@precisiontranslationtools.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CABv3vZmFzOWGtY=myOAUJK5ODdH7pswACP6snbFF=pk+Se++bQ@mail.gmail.com>
Content-Type: text/plain; charset=UTF-8

Tom,

The original paper is Xiong et al (2011)
"Enhancing Language Models in Statistical Machine Translation with
Backward N-grams and Mutual Information Triggers"
http://aclweb.org/anthology//P/P11/P11-1129.pdf

I implemented the backward n-gram functionality in Moses, beginning
with the following commit:
https://github.com/moses-smt/mosesdecoder/commit/8459a86137f7d15834009557a62c4278479da088

You can browse my subsequent related commits:
https://github.com/moses-smt/mosesdecoder/commits?author=dowobeha

Lane


On Mon, Feb 3, 2014 at 2:13 PM, Tom Hoar
<tahoar@precisiontranslationtools.com> wrote:
> I've seen several references to "backward LM" on the list. I just searched
> statmt.org/moses but didn't find any details. What is a good source for a
> description?
> Thanks.
>
>
>
>
> On 02/03/2014 09:06 PM, Hieu Hoang wrote:
>
> If the programs
> bin/moses
> bin/moses_chart
> and others have been created, maybe you can ignore the error.
>
> The error is from a unit test for the backward LM. If may to be specific to
> a gcc version or OS. If you don't use backward LM, you may not need to worry
> about it
>
>
>
> On 2 February 2014 14:09, Sehrob Ibrohimov <isehrob@gmail.com> wrote:
>>
>> Hello everybody!
>> I am having building problems. when I try to build the moses I get
>> this error message:
>>
>> ##########################################################################
>> ====== BEGIN OUTPUT ======
>> Running 1 test case...
>> moses/LM/BackwardTest.cpp(162): error in "ProbingAll":
>> difference{100%} between static_cast<double>(TransformLMScore( 0.0
>> )){0} and static_cast<double>(ngramScore){1.3724476843890443e-07}
>> exceeds 0.01%
>>
>> *** 1 failure detected in test suite "BackwardTest"
>>
>> EXIT STATUS: 201
>> ====== END OUTPUT ======
>> ...failed testing.capture-output
>>
>> moses/LM/bin/BackwardTest.test/gcc-4.6/release/debug-symbols-on/link-static/threading-multi/BackwardTest.run...
>> ...failed updating 1 target...
>> ...skipped 1 target...
>> ...updated 4 targets...
>> The build failed with command line:
>> ./jam-files/bjam --debug-configuration -d2
>>
>> ############################################################################
>>
>> I've attached the build.log. please help me fix the problem!
>> thanks a lot!
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>
>
>
> --
> Hieu Hoang
> Research Associate
> University of Edinburgh
> http://www.hoang.co.uk/hieu
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>



--
When a place gets crowded enough to require ID's, social collapse is not
far away. It is time to go elsewhere. The best thing about space travel
is that it made it possible to go elsewhere.
-- R.A. Heinlein, "Time Enough For Love"


------------------------------

Message: 2
Date: Mon, 03 Feb 2014 21:44:39 +0700
From: Tom Hoar <tahoar@precisiontranslationtools.com>
Subject: Re: [Moses-support] Building problem
To: moses-support@mit.edu
Message-ID: <52EFAB57.3060709@precisiontranslationtools.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed

Thank you very much, Lane.


On 02/03/2014 09:41 PM, Lane Schwartz wrote:
> Tom,
>
> The original paper is Xiong et al (2011)
> "Enhancing Language Models in Statistical Machine Translation with
> Backward N-grams and Mutual Information Triggers"
> http://aclweb.org/anthology//P/P11/P11-1129.pdf
>
> I implemented the backward n-gram functionality in Moses, beginning
> with the following commit:
> https://github.com/moses-smt/mosesdecoder/commit/8459a86137f7d15834009557a62c4278479da088
>
> You can browse my subsequent related commits:
> https://github.com/moses-smt/mosesdecoder/commits?author=dowobeha
>
> Lane
>
>
> On Mon, Feb 3, 2014 at 2:13 PM, Tom Hoar
> <tahoar@precisiontranslationtools.com> wrote:
>> I've seen several references to "backward LM" on the list. I just searched
>> statmt.org/moses but didn't find any details. What is a good source for a
>> description?
>> Thanks.
>>
>>
>>
>>
>> On 02/03/2014 09:06 PM, Hieu Hoang wrote:
>>
>> If the programs
>> bin/moses
>> bin/moses_chart
>> and others have been created, maybe you can ignore the error.
>>
>> The error is from a unit test for the backward LM. If may to be specific to
>> a gcc version or OS. If you don't use backward LM, you may not need to worry
>> about it
>>
>>
>>
>> On 2 February 2014 14:09, Sehrob Ibrohimov <isehrob@gmail.com> wrote:
>>> Hello everybody!
>>> I am having building problems. when I try to build the moses I get
>>> this error message:
>>>
>>> ##########################################################################
>>> ====== BEGIN OUTPUT ======
>>> Running 1 test case...
>>> moses/LM/BackwardTest.cpp(162): error in "ProbingAll":
>>> difference{100%} between static_cast<double>(TransformLMScore( 0.0
>>> )){0} and static_cast<double>(ngramScore){1.3724476843890443e-07}
>>> exceeds 0.01%
>>>
>>> *** 1 failure detected in test suite "BackwardTest"
>>>
>>> EXIT STATUS: 201
>>> ====== END OUTPUT ======
>>> ...failed testing.capture-output
>>>
>>> moses/LM/bin/BackwardTest.test/gcc-4.6/release/debug-symbols-on/link-static/threading-multi/BackwardTest.run...
>>> ...failed updating 1 target...
>>> ...skipped 1 target...
>>> ...updated 4 targets...
>>> The build failed with command line:
>>> ./jam-files/bjam --debug-configuration -d2
>>>
>>> ############################################################################
>>>
>>> I've attached the build.log. please help me fix the problem!
>>> thanks a lot!
>>>
>>> _______________________________________________
>>> Moses-support mailing list
>>> Moses-support@mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>>
>>
>> --
>> Hieu Hoang
>> Research Associate
>> University of Edinburgh
>> http://www.hoang.co.uk/hieu
>>
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>
>



------------------------------

Message: 3
Date: Mon, 03 Feb 2014 16:11:21 +0100
From: Prashant Mathur <prashant@fbk.eu>
Subject: Re: [Moses-support] Building problem
To: Lane Schwartz <dowobeha@gmail.com>, Tom Hoar
<tahoar@precisiontranslationtools.com>
Cc: "moses-support@mit.edu" <moses-support@mit.edu>
Message-ID: <52EFB199.2000108@fbk.eu>
Content-Type: text/plain; charset="iso-8859-1"

Hi Lane,

Since you mentioned this paper, did you also implement MI triggers for LM?
I tried using cross-lingual triggers in Moses as mentioned in [1], but
it didn't seem to work for me.

[1] Using inter-lingual triggers for machine translation. Lavecchia et.
al. 07.
link : http://www.loria.fr/~smaili/interspeechCaro07.pdf
<http://www.loria.fr/%7Esmaili/interspeechCaro07.pdf>

Thanks,
--
Prashant

On 02/03/2014 03:41 PM, Lane Schwartz wrote:
> Tom,
>
> The original paper is Xiong et al (2011)
> "Enhancing Language Models in Statistical Machine Translation with
> Backward N-grams and Mutual Information Triggers"
> http://aclweb.org/anthology//P/P11/P11-1129.pdf
>
> I implemented the backward n-gram functionality in Moses, beginning
> with the following commit:
> https://github.com/moses-smt/mosesdecoder/commit/8459a86137f7d15834009557a62c4278479da088
>
> You can browse my subsequent related commits:
> https://github.com/moses-smt/mosesdecoder/commits?author=dowobeha
>
> Lane
>
>
> On Mon, Feb 3, 2014 at 2:13 PM, Tom Hoar
> <tahoar@precisiontranslationtools.com> wrote:
>> I've seen several references to "backward LM" on the list. I just searched
>> statmt.org/moses but didn't find any details. What is a good source for a
>> description?
>> Thanks.
>>
>>
>>
>>
>> On 02/03/2014 09:06 PM, Hieu Hoang wrote:
>>
>> If the programs
>> bin/moses
>> bin/moses_chart
>> and others have been created, maybe you can ignore the error.
>>
>> The error is from a unit test for the backward LM. If may to be specific to
>> a gcc version or OS. If you don't use backward LM, you may not need to worry
>> about it
>>
>>
>>
>> On 2 February 2014 14:09, Sehrob Ibrohimov <isehrob@gmail.com> wrote:
>>> Hello everybody!
>>> I am having building problems. when I try to build the moses I get
>>> this error message:
>>>
>>> ##########################################################################
>>> ====== BEGIN OUTPUT ======
>>> Running 1 test case...
>>> moses/LM/BackwardTest.cpp(162): error in "ProbingAll":
>>> difference{100%} between static_cast<double>(TransformLMScore( 0.0
>>> )){0} and static_cast<double>(ngramScore){1.3724476843890443e-07}
>>> exceeds 0.01%
>>>
>>> *** 1 failure detected in test suite "BackwardTest"
>>>
>>> EXIT STATUS: 201
>>> ====== END OUTPUT ======
>>> ...failed testing.capture-output
>>>
>>> moses/LM/bin/BackwardTest.test/gcc-4.6/release/debug-symbols-on/link-static/threading-multi/BackwardTest.run...
>>> ...failed updating 1 target...
>>> ...skipped 1 target...
>>> ...updated 4 targets...
>>> The build failed with command line:
>>> ./jam-files/bjam --debug-configuration -d2
>>>
>>> ############################################################################
>>>
>>> I've attached the build.log. please help me fix the problem!
>>> thanks a lot!
>>>
>>> _______________________________________________
>>> Moses-support mailing list
>>> Moses-support@mit.edu
>>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>>
>>
>>
>> --
>> Hieu Hoang
>> Research Associate
>> University of Edinburgh
>> http://www.hoang.co.uk/hieu
>>
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>>
>>
>> _______________________________________________
>> Moses-support mailing list
>> Moses-support@mit.edu
>> http://mailman.mit.edu/mailman/listinfo/moses-support
>>
>
>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mailman.mit.edu/mailman/private/moses-support/attachments/20140203/926dacdf/attachment-0001.htm

------------------------------

Message: 4
Date: Mon, 3 Feb 2014 16:05:43 +0000
From: Lane Schwartz <dowobeha@gmail.com>
Subject: Re: [Moses-support] Building problem
To: Prashant Mathur <prashant@fbk.eu>
Cc: Tom Hoar <tahoar@precisiontranslationtools.com>,
"moses-support@mit.edu" <moses-support@mit.edu>
Message-ID:
<CABv3vZkG+Z3QVP91H0YPk7i_8efwaYWxTXceUOVJs5kTSRVdPw@mail.gmail.com>
Content-Type: text/plain; charset=UTF-8

No, I did not implement cross-lingual triggers.

On Mon, Feb 3, 2014 at 3:11 PM, Prashant Mathur <prashant@fbk.eu> wrote:
> Hi Lane,
>
> Since you mentioned this paper, did you also implement MI triggers for LM?
> I tried using cross-lingual triggers in Moses as mentioned in [1], but it
> didn't seem to work for me.
>
> [1] Using inter-lingual triggers for machine translation. Lavecchia et. al.
> 07.
> link : http://www.loria.fr/~smaili/interspeechCaro07.pdf
>
> Thanks,
> --
> Prashant
>
>
> On 02/03/2014 03:41 PM, Lane Schwartz wrote:
>
> Tom,
>
> The original paper is Xiong et al (2011)
> "Enhancing Language Models in Statistical Machine Translation with
> Backward N-grams and Mutual Information Triggers"
> http://aclweb.org/anthology//P/P11/P11-1129.pdf
>
> I implemented the backward n-gram functionality in Moses, beginning
> with the following commit:
> https://github.com/moses-smt/mosesdecoder/commit/8459a86137f7d15834009557a62c4278479da088
>
> You can browse my subsequent related commits:
> https://github.com/moses-smt/mosesdecoder/commits?author=dowobeha
>
> Lane
>
>
> On Mon, Feb 3, 2014 at 2:13 PM, Tom Hoar
> <tahoar@precisiontranslationtools.com> wrote:
>
> I've seen several references to "backward LM" on the list. I just searched
> statmt.org/moses but didn't find any details. What is a good source for a
> description?
> Thanks.
>
>
>
>
> On 02/03/2014 09:06 PM, Hieu Hoang wrote:
>
> If the programs
> bin/moses
> bin/moses_chart
> and others have been created, maybe you can ignore the error.
>
> The error is from a unit test for the backward LM. If may to be specific to
> a gcc version or OS. If you don't use backward LM, you may not need to worry
> about it
>
>
>
> On 2 February 2014 14:09, Sehrob Ibrohimov <isehrob@gmail.com> wrote:
>
> Hello everybody!
> I am having building problems. when I try to build the moses I get
> this error message:
>
> ##########################################################################
> ====== BEGIN OUTPUT ======
> Running 1 test case...
> moses/LM/BackwardTest.cpp(162): error in "ProbingAll":
> difference{100%} between static_cast<double>(TransformLMScore( 0.0
> )){0} and static_cast<double>(ngramScore){1.3724476843890443e-07}
> exceeds 0.01%
>
> *** 1 failure detected in test suite "BackwardTest"
>
> EXIT STATUS: 201
> ====== END OUTPUT ======
> ...failed testing.capture-output
>
> moses/LM/bin/BackwardTest.test/gcc-4.6/release/debug-symbols-on/link-static/threading-multi/BackwardTest.run...
> ...failed updating 1 target...
> ...skipped 1 target...
> ...updated 4 targets...
> The build failed with command line:
> ./jam-files/bjam --debug-configuration -d2
>
> ############################################################################
>
> I've attached the build.log. please help me fix the problem!
> thanks a lot!
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
> --
> Hieu Hoang
> Research Associate
> University of Edinburgh
> http://www.hoang.co.uk/hieu
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
> _______________________________________________
> Moses-support mailing list
> Moses-support@mit.edu
> http://mailman.mit.edu/mailman/listinfo/moses-support
>
>
>
>



--
When a place gets crowded enough to require ID's, social collapse is not
far away. It is time to go elsewhere. The best thing about space travel
is that it made it possible to go elsewhere.
-- R.A. Heinlein, "Time Enough For Love"


------------------------------

_______________________________________________
Moses-support mailing list
Moses-support@mit.edu
http://mailman.mit.edu/mailman/listinfo/moses-support


End of Moses-support Digest, Vol 88, Issue 3
********************************************

0 Response to "Moses-support Digest, Vol 88, Issue 3"

Post a Comment