Skip to content
This repository has been archived by the owner on Feb 19, 2020. It is now read-only.

Failed to train CTB #70

Open
yuanyunzhe opened this issue Apr 6, 2018 · 0 comments
Open

Failed to train CTB #70

yuanyunzhe opened this issue Apr 6, 2018 · 0 comments

Comments

@yuanyunzhe
Copy link

yuanyunzhe commented Apr 6, 2018

I tried to retrain the parser on CTB by converting original .fid files to .mrg files and adding the parameter --treebank.treebankType chinese, but it failed and here is the error message.

$ java -Xmx47g -cp path/to/assembly.jar epic.parser.models.NeuralParserTrainer --cache.path constraints.cache --opt.useStochastic -treebank.path path/to/ctb/ --treebank.treebankType chinese --evalOnTest --includeDevInTrain --trainer.modelFactory.annotator epic.trees.annotations.PipelineAnnotator --ann.0 epic.trees.annotations.FilterAnnotations --ann.1 epic.trees.annotations.ForgetHeadTag --ann.2 epic.trees.annotations.Markovize --ann.2.horizontal 0 --ann.2.vertical 0 --modelFactory epic.parser.models.PositionalNeuralModelFactory --threads 8
[main] INFO epic.parser.models.NeuralParserTrainer$ - Training Parser...
Exception in thread "main" java.lang.RuntimeException: error while indexingBinaryRule(@QP[^DP],QP[^QP],CC[^QP]) to BinaryRule(@QP,QP,CC)0
        at epic.parser.projections.ProjectionIndexer$$anonfun$apply$5.apply(ProjectionIndexer.scala:114)
        at epic.parser.projections.ProjectionIndexer$$anonfun$apply$5.apply(ProjectionIndexer.scala:110)
        at scala.collection.TraversableLike$WithFilter$$anonfun$foreach$1.apply(TraversableLike.scala:733)
        at scala.collection.immutable.List.foreach(List.scala:381)
        at scala.collection.TraversableLike$WithFilter.foreach(TraversableLike.scala:732)
        at epic.parser.projections.ProjectionIndexer$.apply(ProjectionIndexer.scala:110)
        at epic.parser.projections.GrammarRefinements$.apply(GrammarRefinements.scala:177)
        at epic.parser.GenerativeParser$.annotated(GenerativeParser.scala:124)
        at epic.parser.GenerativeParser$.annotatedParser(GenerativeParser.scala:107)
        at epic.parser.models.NeuralParserTrainer$.trainParser(NeuralParserTrainer.scala:91)
        at epic.parser.models.NeuralParserTrainer$.trainParser(NeuralParserTrainer.scala:35)
        at epic.parser.ParserPipeline$class.trainParser(ParserPipeline.scala:92)
        at epic.parser.models.NeuralParserTrainer$.trainParser(NeuralParserTrainer.scala:35)
        at epic.parser.ParserPipeline$class.main(ParserPipeline.scala:107)
        at epic.parser.models.NeuralParserTrainer$.main(NeuralParserTrainer.scala:35)
        at epic.parser.models.NeuralParserTrainer.main(NeuralParserTrainer.scala)

So could you help me to find where the mistake is? Thanks a lot!

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant