Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Possible G2P problem #10

Open
aStereoID opened this issue Apr 26, 2021 · 5 comments
Open

Possible G2P problem #10

aStereoID opened this issue Apr 26, 2021 · 5 comments
Assignees
@psibre @aStereoID
Labels
bug Something isn't working

Comments

@aStereoID
Copy link
Collaborator

When running and testing the voice in a local MaryTTS server, audio output with test sentences containing "kedźbnosć" always results in the following abort: "INFO marytts.server Request couldn't be handled successfully".
However, phonemes output works.
@aStereoID aStereoID added the bug Something isn't working label Apr 26, 2021
@psibre
Copy link
Member

psibre commented Apr 27, 2021

I'm afraid I can't reproduce this. I get the following ACOUSTPARAMS output:

<?xml version="1.0" encoding="UTF-8"?>
<maryxml xmlns="http://mary.dfki.de/2002/MaryXML" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" version="0.5" xml:lang="hsb">
  <p>
    <s>
      <phrase>
        <t accent="!H*" g2p_method="rules" ph="' k E dZ - b n O s tS" pos="content">
          kedźbnosć
          <syllable accent="!H*" ph="k E dZ" stress="1">
            <ph d="168" end="0.168283" p="k"/>
            <ph d="39" end="0.2075282" f0="(0,98) (50,94)" p="E"/>
            <ph d="39" end="0.2468016" f0="(100,94)" p="dZ"/>
          </syllable>
          <syllable ph="b n O s tS">
            <ph d="59" end="0.3060686" f0="(0,98)" p="b"/>
            <ph d="38" end="0.3445301" p="n"/>
            <ph d="122" end="0.4669241" f0="(50,96) (100,96)" p="O"/>
            <ph d="39" end="0.5061693" p="s"/>
            <ph d="168" end="0.6744523" p="tS"/>
          </syllable>
        </t>
        <boundary breakindex="5" duration="400" tone="L-L%"/>
      </phrase>
    </s>
  </p>
</maryxml>

and the attached audio and TextGrid:
kedźbnosć.zip

@psibre
Copy link
Member

psibre commented Apr 27, 2021

@aStereoID Could you please paste or attach the exact input and debug log that trigger the error?

@aStereoID
Copy link
Collaborator Author

hm.. I get this ACOUSTPARAMS output:

<?xml version="1.0" encoding="UTF-8"?><maryxml xmlns="http://mary.dfki.de/2002/MaryXML" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" version="0.5" xml:lang="hsb">
    <p>
        <s>
            <phrase>
                <t accent="!H*" g2p_method="rules" ph="' k E dZ - b n O s tS" pos="content">
                    kedźbnosć

                    <syllable accent="!H*" ph="k E dZ" stress="1">
                        <ph d="58" end="0.057875" p="k"/>
                        <ph d="73" end="0.1309261" f0="(0,104) (50,100)" p="E"/>
                        <ph d="45" end="0.1763522" f0="(100,91)" p="dZ"/>
                    </syllable>
                    <syllable ph="b n O s tS">
                        <ph d="50" end="0.2262723" f0="(0,103)" p="b"/>
                        <ph d="67" end="0.2933393" p="n"/>
                        <ph d="73" end="0.3663904" f0="(50,97) (100,91)" p="O"/>
                        <ph d="168" end="0.5340554" p="s"/>
                        <ph d="168" end="0.7017204" p="tS"/>
                    </syllable>
                </t>
                <boundary breakindex="5" duration="400" tone="L-L%"/>
            </phrase>
        </s>
    </p>
</maryxml>

but trying to get AUDIO output leads to this:

2021-04-27 15:06:04,341 [I/O dispatcher 1] INFO  marytts.R 0 New request (input type "TEXT", output type "AUDIO", voice "hsb_poc", effect "", audio "WAVE")
2021-04-27 15:06:04,342 [I/O dispatcher 1] INFO  marytts.server Read: kedźbnosć
2021-04-27 15:06:04,342 [I/O dispatcher 1] INFO  marytts.R 0 Handling request using the following modules:
2021-04-27 15:06:04,342 [I/O dispatcher 1] INFO  marytts.R 0 - TextToMaryXML (marytts.modules.TextToMaryXML)
2021-04-27 15:06:04,342 [I/O dispatcher 1] INFO  marytts.R 0 Next module: TextToMaryXML
2021-04-27 15:06:04,344 [I/O dispatcher 1] INFO  marytts.R 0 Handling request using the following modules:
2021-04-27 15:06:04,344 [I/O dispatcher 1] INFO  marytts.R 0 - JTokeniser (marytts.modules.JTokeniser)
2021-04-27 15:06:04,344 [I/O dispatcher 1] INFO  marytts.R 0 - Preprocess (marytts.language.hsb.Preprocess)
2021-04-27 15:06:04,344 [I/O dispatcher 1] INFO  marytts.R 0 - OpenNLPPosTagger (marytts.modules.MinimalisticPosTagger)
2021-04-27 15:06:04,344 [I/O dispatcher 1] INFO  marytts.R 0 - JPhonemiser (marytts.language.hsb.UpperSorbianPhonemiser)
2021-04-27 15:06:04,344 [I/O dispatcher 1] INFO  marytts.R 0 - Prosody (marytts.modules.ProsodyGeneric)
2021-04-27 15:06:04,344 [I/O dispatcher 1] INFO  marytts.R 0 - PronunciationModel (marytts.modules.PronunciationModel)
2021-04-27 15:06:04,344 [I/O dispatcher 1] INFO  marytts.R 0 - AcousticModeller (marytts.modules.AcousticModeller)
2021-04-27 15:06:04,344 [I/O dispatcher 1] INFO  marytts.R 0 - Synthesis (marytts.modules.Synthesis)
2021-04-27 15:06:04,344 [I/O dispatcher 1] INFO  marytts.R 0 Next module: JTokeniser
2021-04-27 15:06:04,351 [I/O dispatcher 1] INFO  marytts.R 0 Next module: Preprocess
2021-04-27 15:06:04,368 [I/O dispatcher 1] INFO  marytts.R 0 Next module: OpenNLPPosTagger
2021-04-27 15:06:04,369 [I/O dispatcher 1] INFO  marytts.R 0 Next module: JPhonemiser
2021-04-27 15:06:04,375 [I/O dispatcher 1] INFO  marytts.R 0 Next module: Prosody
2021-04-27 15:06:04,376 [I/O dispatcher 1] INFO  marytts.R 0 Next module: PronunciationModel
2021-04-27 15:06:04,377 [I/O dispatcher 1] INFO  marytts.R 0 Next module: AcousticModeller
2021-04-27 15:06:04,388 [I/O dispatcher 1] INFO  marytts.R 0 Next module: Synthesis
2021-04-27 15:06:04,437 [I/O dispatcher 1] ERROR marytts.server Processing failed.
java.lang.Exception: Module Synthesis: Problem processing the data.
        at marytts.server.Request.processOneChunk(Request.java:568)
        at marytts.server.Request.processOrLookupOneChunk(Request.java:403)
        at marytts.server.Request.process(Request.java:337)
        at marytts.server.http.SynthesisRequestHandler.process(SynthesisRequestHandler.java:261)
        at marytts.server.http.SynthesisRequestHandler.handleClientRequest(SynthesisRequestHandler.java:91)
        at marytts.server.http.BaseHttpRequestHandler.handle(BaseHttpRequestHandler.java:138)
        at org.apache.http.nio.protocol.BufferingHttpServiceHandler$RequestHandlerAdaptor.handle(BufferingHttpServiceHandler.java:189)
        at org.apache.http.nio.protocol.SimpleNHttpRequestHandler.handle(SimpleNHttpRequestHandler.java:51)
        at org.apache.http.nio.protocol.AsyncNHttpServiceHandler.processRequest(AsyncNHttpServiceHandler.java:453)
        at org.apache.http.nio.protocol.AsyncNHttpServiceHandler.requestReceived(AsyncNHttpServiceHandler.java:225)
        at org.apache.http.nio.protocol.BufferingHttpServiceHandler.requestReceived(BufferingHttpServiceHandler.java:127)
        at org.apache.http.impl.nio.DefaultNHttpServerConnection.consumeInput(DefaultNHttpServerConnection.java:161)
        at org.apache.http.impl.nio.DefaultServerIOEventDispatch.inputReady(DefaultServerIOEventDispatch.java:147)
        at org.apache.http.impl.nio.reactor.BaseIOReactor.readable(BaseIOReactor.java:161)
        at org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvent(AbstractIOReactor.java:335)
        at org.apache.http.impl.nio.reactor.AbstractIOReactor.processEvents(AbstractIOReactor.java:315)
        at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:275)
        at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:104)
        at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:542)
        at java.base/java.lang.Thread.run(Thread.java:834)
Caused by: java.nio.BufferUnderflowException
        at java.base/java.nio.Buffer.nextGetIndex(Buffer.java:651)
        at java.base/java.nio.DirectByteBuffer.getLong(DirectByteBuffer.java:850)
        at marytts.unitselection.data.TimelineReader.skipNextDatagram(TimelineReader.java:385)
        at marytts.unitselection.data.TimelineReader.hopToTime(TimelineReader.java:456)
        at marytts.unitselection.data.TimelineReader.getMappedByteBufferAtTime(TimelineReader.java:498)
        at marytts.unitselection.data.TimelineReader.getByteBufferAtTime(TimelineReader.java:483)
        at marytts.unitselection.data.TimelineReader.getDatagram(TimelineReader.java:582)
        at marytts.unitselection.concat.OverlapUnitConcatenator.getDatagramsFromTimeline(OverlapUnitConcatenator.java:64)
        at marytts.unitselection.concat.BaseUnitConcatenator.getAudio(BaseUnitConcatenator.java:113)
        at marytts.unitselection.UnitSelectionSynthesizer.synthesize(UnitSelectionSynthesizer.java:190)
        at marytts.modules.synthesis.Voice.synthesize(Voice.java:527)
        at marytts.modules.Synthesis.synthesizeOneSection(Synthesis.java:252)
        at marytts.modules.Synthesis.process(Synthesis.java:222)
        at marytts.server.Request.processOneChunk(Request.java:566)
        ... 19 more
2021-04-27 15:06:04,443 [I/O dispatcher 1] INFO  marytts.server Request couldn't be handled successfully.

@psibre
Copy link
Member

psibre commented Apr 27, 2021

That seems very strange. I wonder if there is some subtle side-effect of running this on a different OS or with different Java versions. Will investigate tomorrow...

@aStereoID
Copy link
Collaborator Author

@psibre: Could you find out anything new about this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@psibre psibre

@aStereoID aStereoID

Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@psibre @aStereoID