Add extra dependency or JAR file to TornadoVM

[vineetmishra82]

Hi, I am trying to use TornadoVM with Opengamma Strata library for GPU calculations, but am unable to include maven dependency in any pom file or even add jars for it. Please help or guide where to implement it. Thanks

[jjfumero]

Hi @vineetmishra82 . It seems that our maven links do not work for the latest version. We will fix the public JAR files in our maven links. In the meantime, you can explore this solution.

As a workaround, you can install TornadoVM from source code. This will update your maven local repos with all JAR files needed. In any case, you need the TornadoVM built to run your programs because you also need all dynamic libraries to connect to the GPU/FGPA drivers (e.g., CUDA, OpenCL and SPIR-V), as well as the TornadoVM runtime.

You can follow the instructions here:
https://tornadovm.readthedocs.io/en/latest/installation.html

Once you installed it, you can add the new dependency in your Pom files:

   <repositories>
     <repository>
       <id>universityOfManchester-graal</id>
       <url>https://raw.githubusercontent.com/beehive-lab/tornado/maven-tornadovm</url>
     </repository>
   </repositories>
 
   <dependencies>   
      <dependency>
         <groupId>tornado</groupId>
         <artifactId>tornado-api</artifactId>
         <version>0.15.2-dev</version>
      </dependency>

      <dependency>
         <groupId>tornado</groupId>
         <artifactId>tornado-matrices</artifactId>
         <version>0.15.2-dev</version>
      </dependency>
   </dependencies>

[jjfumero]

I found the issue: https://maven.apache.org/plugins/maven-install-plugin/
The checksum generation was removed from Maven 3.0+ .

[vineetmishra82]

Hi Juan,

Let me first express my thrill to be talking to you directly. Really admire your work.

I am trying to use TornadoVM with opengamma strata calculation to be run on GPU on a ubuntu server (only command line).

TornadoVM has given me sleepless nights ever since I tried to start work on it being a regular Java guy. I am able to set it up properly as you can see here :

Even your example on the installation works fine (2dMatrixmultiplication):

So brave enough, I created a Simple Java Maven project with just one Main method, which has same code as your tornado-examples/src/main/java/uk/ac/manchester/tornado/examples/compute/MatrixMultiplication2D.java in the Main.java class

But the moment I download from Github, do mvn package and try to run it with tornado all hell break loose. I use shade plugin to consolidate all jars with name openStrata.jar. As you can see below execution starts and then boom !

Same thing happens with docker image too.

vineet@uboa:~/OpenGammaStrata_Tornado/src/main/java/com/kpts/port23$ tornado -cp target/openStrata.jar Main.java 100 starting project..... Computing MxM of 100x100 Inside main method java.io.IOException: Class not found at org.objectweb.asm@9.4/org.objectweb.asm.ClassReader.readStream(ClassReader.java:315) at org.objectweb.asm@9.4/org.objectweb.asm.ClassReader.<init>(ClassReader.java:287) at tornado.annotation@0.15.2-dev/uk.ac.manchester.tornado.annotation.ASMClassVisitor.getParallelAnnotations(ASMClassVisitor.java:57) at tornado.runtime@0.15.2-dev/uk.ac.manchester.tornado.runtime.graal.phases.TornadoApiReplacement.replaceLocalAnnotations(TornadoApiReplacement.java:90) at tornado.runtime@0.15.2-dev/uk.ac.manchester.tornado.runtime.graal.phases.TornadoApiReplacement.run(TornadoApiReplacement.java:61) at tornado.runtime@0.15.2-dev/uk.ac.manchester.tornado.runtime.graal.phases.TornadoApiReplacement.run(TornadoApiReplacement.java:57) at jdk.internal.vm.compiler/org.graalvm.compiler.phases.BasePhase.apply(BasePhase.java:446) at jdk.internal.vm.compiler/org.graalvm.compiler.phases.BasePhase.apply(BasePhase.java:334) at jdk.internal.vm.compiler/org.graalvm.compiler.phases.PhaseSuite.run(PhaseSuite.java:390) at jdk.internal.vm.compiler/org.graalvm.compiler.phases.BasePhase.apply(BasePhase.java:446) at jdk.internal.vm.compiler/org.graalvm.compiler.phases.BasePhase.apply(BasePhase.java:334) at tornado.runtime@0.15.2-dev/uk.ac.manchester.tornado.runtime.sketcher.TornadoSketcher.buildSketch(TornadoSketcher.java:202) at tornado.runtime@0.15.2-dev/uk.ac.manchester.tornado.runtime.sketcher.TornadoSketcher$TornadoSketcherCallable.call(TornadoSketcher.java:162) at tornado.runtime@0.15.2-dev/uk.ac.manchester.tornado.runtime.sketcher.TornadoSketcher$TornadoSketcherCallable.call(TornadoSketcher.java:152) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:829) WARNING: Code Bailout to Java sequential. Use --debug to see the reason Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: Index -1 out of bounds for length 256 at tornado.runtime@0.15.2-dev/uk.ac.manchester.tornado.runtime.graph.TornadoGraph.getNode(TornadoGraph.java:50) at tornado.runtime@0.15.2-dev/uk.ac.manchester.tornado.runtime.graph.TornadoGraphBuilder.buildGraph(TornadoGraphBuilder.java:231) at tornado.runtime@0.15.2-dev/uk.ac.manchester.tornado.runtime.tasks.TornadoTaskGraph.compile(TornadoTaskGraph.java:626) at tornado.runtime@0.15.2-dev/uk.ac.manchester.tornado.runtime.tasks.TornadoTaskGraph.compileToTornadoVMBytecode(TornadoTaskGraph.java:695) at tornado.runtime@0.15.2-dev/uk.ac.manchester.tornado.runtime.tasks.TornadoTaskGraph.warmup(TornadoTaskGraph.java:951) at tornado.api@0.15.2-dev/uk.ac.manchester.tornado.api.TaskGraph.warmup(TaskGraph.java:798) at tornado.api@0.15.2-dev/uk.ac.manchester.tornado.api.ImmutableTaskGraph.warmup(ImmutableTaskGraph.java:89) at java.base/java.util.ArrayList.forEach(ArrayList.java:1541) at tornado.api@0.15.2-dev/uk.ac.manchester.tornado.api.TornadoExecutionPlan$TornadoExecutor.warmup(TornadoExecutionPlan.java:319) at tornado.api@0.15.2-dev/uk.ac.manchester.tornado.api.TornadoExecutionPlan.withWarmUp(TornadoExecutionPlan.java:148) at com.kpts.port23.Main.main(Main.java:59)

My POM file with updated dependencies ;

`
4.0.0
com.kpts.port23
com.kpts.port23
0.0.1-SNAPSHOT
OpenGammaStrataProcessing_Tornado

11 11 universityOfManchester-graal https://raw.githubusercontent.com/beehive-lab/tornado/maven-tornadovm tornado tornado-api 0.15.2-dev

  <dependency>
     <groupId>tornado</groupId>
     <artifactId>tornado-matrices</artifactId>
     <version>0.15.2-dev</version>
  </dependency>

com.opengamma.strata strata-measure 2.12.27 jdk-11 false org.graalvm.truffle truffle-api 23.0.0

openStrata

		<!-- download source code in Eclipse, best practice -->
		<plugin>
			<groupId>org.apache.maven.plugins</groupId>
			<artifactId>maven-eclipse-plugin</artifactId>
			<version>2.9</version>
			<configuration>
				<downloadSources>true</downloadSources>
				<downloadJavadocs>false</downloadJavadocs>
			</configuration>
		</plugin>

		<!-- Set a compiler level -->
		<plugin>			
			<groupId>org.apache.maven.plugins</groupId>
			 <artifactId>maven-compiler-plugin</artifactId>
				<version>3.11.0</version>
			<configuration>
				<source>11</source>
				<target>11</target>
			</configuration>
		</plugin>

	<!-- Maven Shade Plugin -->
	<plugin>
	   <groupId>org.apache.maven.plugins</groupId>
		 <artifactId>maven-shade-plugin</artifactId>
			  <version>3.5.0</version>
	  <executions>
	     <!-- Run shade goal on package phase -->
	    <execution>
		<phase>package</phase>
		<goals>
			<goal>shade</goal>
		</goals>
		<configuration>
		  <transformers>
			<!-- add Main-Class to manifest file -->
                            <transformer implementation="org.apache.maven.plugins.shade.resource.ManifestResourceTransformer">
				<mainClass>com.kpts.port23.Main</mainClass>
			</transformer>
		  </transformers>
		</configuration>
	      </execution>
	  </executions>
	</plugin>

	</plugins>

`

I even tried to include my code in your tornado-examples folder, update modules.info and then do

make jdk-11-plus BACKEND={ptx,opencl}

And it worked. But the problem there is I cannot use Opengamma strata dependency there, no many how many places and POM i update, it just doesnt work. Also I tried manually inserting JARs but never works.

So my question that I posted initially (half asleep I might add ;) ) was asking you how to include dependency or JARs in your example as I am/was exhausted installing TornadoVM and trying to run my project.

Any help will be highly appreciated

[jjfumero]

I am not familiarized with opengamma. But from the stacktrace you shared, it seems some of the Java flags are overwritten. I would say check that your maven configuration is not overriding flags that TornadoVM needs.

You can check all Java flags that TornadoVM uses by invoking:

$ tornado --printJavaFlags

If you need a Maven template with TornadoVM, we have this repo with only examples. Feel free to adapt it to your needs.

https://github.com/jjfumero/tornadovm-examples

There we have instructions about how to start and run the examples.

[vineetmishra82]

Thank you Juan, trying it now.

Also I tried to run the project again after removing opengamma dependency -> build again and run, but result is still the same.

[vineetmishra82]

Hi @jjfumero Juan

It didnt work from your maven examples. Your examples work but not the modified ones, as what I saw is GPU processing only works with primitive data types in Java. Even a hint of objects or any other item, it crashes.

Maybe as it converts from Java to C code which doesnt have objects.

Thank you so much for your assistance and replies.