Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

dev branch for MA #1

Open
wants to merge 23 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
23 commits
Select commit Hold shift + click to select a range
7809649
added vagrantfiles to LSTM repository
privatereese Jun 3, 2019
7cffaaf
structured python files into one folder
privatereese Jun 19, 2019
082621a
Merge remote-tracking branch 'sam/master' into dev
privatereese Aug 22, 2019
df9c96e
rewrote data_preparation
privatereese Sep 5, 2019
dd0c092
added timestamps
privatereese Sep 5, 2019
2c2f519
catched error where datasets are not fully completed in jobs table
privatereese Sep 5, 2019
f8ba1be
changed prediction.py
privatereese Sep 7, 2019
f83b34d
enhanced data_preparation
privatereese Sep 7, 2019
5e56d1e
Merge branch 'dev' of github.com:malsami/LSTM into dev
privatereese Sep 7, 2019
e1a22e3
moved data_preparation and updated prediction, could be improved further
privatereese Sep 7, 2019
4f0b26a
updated Data_preparation to accept a different DB
privatereese Sep 8, 2019
626490e
added gitignore file
privatereese Sep 8, 2019
78c0fd4
Updated environment setup and prediction
privatereese Sep 8, 2019
32da32c
corrected typo
privatereese Sep 8, 2019
35664b0
fixed missing spaces in string
privatereese Sep 8, 2019
f7b1d45
Added a random value to dataset split
privatereese Sep 8, 2019
284e8cc
fixed minor typos
privatereese Sep 9, 2019
9b224b6
edited CUDNNLSTM and Data_preparation
privatereese Sep 9, 2019
57201f5
put time in it
privatereese Sep 9, 2019
e3b8733
deleted timer again will be done with linux (time)
privatereese Sep 9, 2019
106c517
adapted some values to fit smaller tensor range
privatereese Sep 9, 2019
8ded36d
adopted values to fit the new name
privatereese Sep 9, 2019
b0d12c7
adpoted new shape of features and fixed warning supression
privatereese Sep 9, 2019
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
1 change: 1 addition & 0 deletions .gitignore
@@ -0,0 +1 @@
.idea/
175 changes: 0 additions & 175 deletions Data_preparation.py

This file was deleted.

4 changes: 2 additions & 2 deletions README.md
Expand Up @@ -24,7 +24,7 @@ The first step is to preprocess the data. The database was imported and transfor
5. Task Critical time: Integer
6. Number of Jobs: Integer
From Jobs only one feature was selected: Job Exit_Value: String.
After exporting all tables, start with Data_preparation.py. Line 165 is responsible for the length of the feature vector.
After exporting all tables, start with Data_preparation.py.
Feature and labels are save in the end.


Expand All @@ -35,7 +35,7 @@ CuDNNLSTM.py. When using CPU, install Tensorflow and replace CuDNNLSTM with LSTM
Evaluation.py. Evaluation prints the confusion matrix and classification report. Tensorboard can be launched by typing tensorboard -–logdir=logs/ into the terminal and logs from trained models can be visualized

**4. Prediction:**
predictin.py. A CSV file will be save with actual and predictied values. The trained model should be loaded first.
prediction.py. A CSV file will be save with actual and predicted values. The trained model should be loaded first.

**5. Plotting:**
Plotting.py. Another way to visualize the model built.
Expand Down
73 changes: 73 additions & 0 deletions Vagrantfile
@@ -0,0 +1,73 @@
# -*- mode: ruby -*-
# vi: set ft=ruby :

# All Vagrant configuration is done below. The "2" in Vagrant.configure
# configures the configuration version (we support older styles for
# backwards compatibility). Please don't change it unless you know what
# you're doing.
Vagrant.configure("2") do |config|
# The most common configuration options are documented and commented below.
# For a complete reference, please see the online documentation at
# https://docs.vagrantup.com.

# Every Vagrant development environment requires a box. You can search for
# boxes at https://atlas.hashicorp.com/search.
config.vm.box = "ubuntu/xenial64"

# Disable automatic box update checking. If you disable this, then
# boxes will only be checked for updates when the user runs
# `vagrant box outdated`. This is not recommended.
# config.vm.box_check_update = false

# Create a forwarded port mapping which allows access to a specific port
# within the machine from a port on the host machine. In the example below,
# accessing "localhost:8080" will access port 80 on the guest machine.
# config.vm.network "forwarded_port", guest: 80, host: 8080

# Create a private network, which allows host-only access to the machine
# using a specific IP.
# config.vm.network "private_network", ip: "192.168.33.10"
# config.vm.network "public_network", ip: "127.0.0.1", bridge: "enp0s25"


# Create a public network, which generally matched to bridged network.
# Bridged networks make the machine appear as another physical device on
# your network.
config.vm.network "public_network", :mac => "0A0100000000", :auto_config => false

# Share an additional folder to the guest VM. The first argument is
# the path on the host to the actual folder. The second argument is
# the path on the guest to mount the folder. And the optional third
# argument is a set of non-required options.
# config.vm.synced_folder "../data", "/vagrant_data"

# Provider-specific configuration so you can fine-tune various
# backing providers for Vagrant. These expose provider-specific options.
# Example for VirtualBox:
#
config.vm.provider "virtualbox" do |vb|
# # Display the VirtualBox GUI when booting the machine
vb.gui = false
#
# # Customize the amount of memory on the VM:
vb.memory = 4096
vb.cpus = 2
end
#
# View the documentation for the provider you are using for more
# information on available options.

# Define a Vagrant Push strategy for pushing to Atlas. Other push strategies
# such as FTP and Heroku are also available. See the documentation at
# https://docs.vagrantup.com/v2/push/atlas.html for more information.
# config.push.define "atlas" do |push|
# push.app = "YOUR_ATLAS_USERNAME/YOUR_APPLICATION_NAME"
# end

# Enable provisioning with a shell script. Additional provisioners such as
# Puppet, Chef, Ansible, Salt, and Docker are also available. Please see the
# documentation for more information about their specific syntax and use.
config.vm.provision "shell", path:"provision.sh", privileged:false;
config.vm.provision "shell", path:"bootstrap.sh" , run:"always";

end
15 changes: 15 additions & 0 deletions bootstrap.sh
@@ -0,0 +1,15 @@

##############################
#
# This is a bootstrap script which is
# run at every startup of the vagrant machine
# If you want to run something just once at provisioning
# and first bootup of the vagrant machine please see
# provision.sh
#
# Contributor: Bernhard Blieninger
##############################

python3 -m venv lstm-virtenv
source lstm-virtenv/bin/activate
pip3 install -r python3-lstm/requirements.txt