Libraries

[goastler]

This issue is a rolling record of what libraries are currently in use and their purpose.

Please leave a comment of the library name, purpose / usage and whether it's a jar or gradle based library.

We can discuss whether libraries should be kept / removed here and get rid of the duplicate gradle / jar entries.

[goastler]

junit v4 via gradle, used for unit testing

[goastler]

guava via gradle, used in my code afaik and can be removed as I only use it a handful of times

[goastler]

apache commons collections v4 via gradle, purpose unknown

[goastler]

apache commons math v3 via gradle, I believe this is to do with fft in rise @MJFlynn ?

[goastler]

hppc correctsearch via gradle, is this for boss @MatthewMiddlehurst ?

[goastler]

jcommander via gradle, used for cmdline params in experiments

[goastler]

jexcelapi via gradle, used for spreadsheets right @james-large ?

[goastler]

kyro via gradle, I believe this is for xgboost

[goastler]

matlab-control via gradle, used for diagrams output during results evaluation

[goastler]

sizeOf via gradle, used for evaluating size of an obj in memory. @MatthewMiddlehurst do you still use this? I don't anymore

[goastler]

xgboost4j via gradle, provides xgboost implementation

[goastler]

guava-testlib via gradle, provides forced garbage collection afaik and nothing else. Potentially get rid of this

[goastler]

gson via gradle, don't think anyone uses this anymore. Handles JSON input/output

[goastler]

duplicate jars / gradle libraries:

• commons collections
• commons math3
• guava
• guava testlib
• hppc
• jcommander
• junit
• kyro
• matlab control
• xgboost4j
• jxl

[goastler]

commons io via jar, not sure what this is used for

[goastler]

jtransforms via jar, not sure what this is used for

[goastler]

liblinear via jar, not sure what this is used for

[goastler]

commons logging via jar, not sure what this is used for

[goastler]

PF and TS-CHIEF wrapped via jar

[goastler]

Two versions of xgboost via jar, iirc one is for windows and one is for linux / the cluster

[MatthewMiddlehurst]

hppc correctsearch via gradle, is this for boss @MatthewMiddlehurst ?

Used in WEASEL

sizeOf via gradle, used for evaluating size of an obj in memory. @MatthewMiddlehurst do you still use this? I don't anymore

I dont use this anymore either

liblinear via jar, not sure what this is used for

Required for WEASEL also, useful to keep. Also going to include libsvm which is similar.

PF and TS-CHIEF wrapped via jar

Can probably get rid of PF now? #435 needs to be done before removing TS-CHIEF

[MatthewMiddlehurst]

From PR #438 and our previous Friday meeting, we are looking to add DL4J/ND4J which has 3 imports recommended from https://deeplearning4j.konduit.ai/getting-started/quickstart.

These are:

// https://mvnrepository.com/artifact/org.deeplearning4j/deeplearning4j-core
compile group: 'org.deeplearning4j', name: 'deeplearning4j-core', version: '1.0.0-beta4'
// https://mvnrepository.com/artifact/org.nd4j/nd4j-native-platform
compile group: 'org.nd4j', name: 'nd4j-native-platform', version: '1.0.0-beta4'
// https://mvnrepository.com/artifact/org.datavec/datavec-api
compile group: 'org.datavec', name: 'datavec-api', version: '1.0.0-beta4'

I chose beta4 as it was the last version to include a setNumThreads function instead of using enviroment variables. For ND4J, native uses a CPU backend and platform includes binaraies for most major OS.