Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
60 commits
Select commit Hold shift + click to select a range
8a92e0b
Added PatchAI.py which currently contains patching for keras. Also
oew1v07 Oct 17, 2018
a4e1d52
Uncommented the PatchAI import in the init
oew1v07 Oct 17, 2018
3d43fa6
Added correct inheritance for multiwrapper patch
oew1v07 Oct 18, 2018
94bf04b
Added conda installs for keras and tensorflow if the python versions …
owilson-os Oct 18, 2018
ee66a22
Removed ModelCheckpoint as uses save and save_weights.
owilson-os Oct 18, 2018
9eb6a8e
Added script to create sample data
owilson-os Oct 18, 2018
b6b38ea
Added writing out of data to joblib file
owilson-os Oct 18, 2018
cf417cb
Finished script to create test data including joblib dump
owilson-os Oct 18, 2018
04d92f8
Added functions to create model called Simplenet and then
owilson-os Oct 19, 2018
649f687
Merge branch 'master' of https://github.com/recipy/recipy
owilson-os Oct 19, 2018
a21d214
Created a single create_sample_data function
owilson-os Oct 19, 2018
2074a25
Removed one input function as its not often used in keras
owilson-os Oct 19, 2018
b0536f7
Fixed format error with the class folders
owilson-os Oct 19, 2018
6bc340e
Fixed model errors but one remaining about the dense layer
owilson-os Oct 19, 2018
2c6a0b3
Realised needed one hot encoding for targets
owilson-os Oct 19, 2018
e3f11e9
Removed lines that were left by a screwed up merge conflict
owilson-os Oct 24, 2018
1e21b0d
Added code to remove mnist dataset downloaded to create sample data
owilson-os Oct 24, 2018
384f09e
Added tests to check saving weights, models and weights during callba…
owilson-os Oct 24, 2018
fbb40ee
Added load_model to input functions in PatchAI.
owilson-os Oct 24, 2018
b552d48
Corrected tests to properly handle data from the joblib file rather t…
owilson-os Oct 24, 2018
55d075c
Added removal of test data after creation to keep things clean.
owilson-os Oct 24, 2018
bfb9537
Started to write keras into test_packages
owilson-os Oct 24, 2018
6531984
Finished the bulk of tests for keras, writing them into test_packages…
owilson-os Oct 29, 2018
fc5002b
Written conda requirements for appveyor
owilson-os Oct 29, 2018
e7f19ba
Remove glob as a conda isntall - it's a built in
oew1v07 Oct 30, 2018
c96d76a
Tried to sort travis if statement by switching [ for (
owilson-os Oct 30, 2018
a583533
Merge branch 'master' of https://github.com/oew1v07/recipy
owilson-os Oct 30, 2018
12f019c
Code to deal with differences between joblib 2 and joblib 3 so it now…
owilson-os Oct 30, 2018
9bbc8bb
Need to create two joblib files for the mnist dataset for use in 2.7
owilson-os Oct 30, 2018
f74131b
Using platform version tuple to make things easier
owilson-os Oct 30, 2018
c9bd2c8
Added mnist3.jbl
owilson-os Oct 31, 2018
64adaaf
Added requirement of keras>=2.2
owilson-os Oct 31, 2018
e16dc16
Added keras>=2.2 to appveyor.yml
owilson-os Oct 31, 2018
923e4bc
Added mnist joblib for python 2.7. Also sorted imports for _obtain_in…
oew1v07 Nov 2, 2018
262c58b
Rewrote run_keras.py to use numpy save as input for the data
owilson-os Nov 5, 2018
8222375
Updated keras version in .travis
owilson-os Nov 5, 2018
b0bdb7a
Updated keras version in appveyor.yml
owilson-os Nov 5, 2018
8d8bd67
Added inputs of np.load to test_packages
owilson-os Nov 5, 2018
a17d4b3
Merge branch 'master' of https://github.com/oew1v07/recipy
owilson-os Nov 5, 2018
38e93e8
Removed mnist2.jbl as no longer using joblib. Modified Model and
owilson-os Nov 5, 2018
84a4d50
Modified model by running create_sample_data
owilson-os Nov 5, 2018
df732bb
Renamed model files to show explicitly which are test ones and which
owilson-os Nov 5, 2018
c53da8c
Removed images to double check output
owilson-os Nov 5, 2018
b0b14c6
Refreshed data to be use by run_keras.py
owilson-os Nov 5, 2018
51bc0f1
Removed inputs from test_packages since it seems to think I shouldn't…
owilson-os Nov 5, 2018
7de3fc0
Removed unused patches without tests
owilson-os Nov 5, 2018
700883f
Made temp variable a string in appveyor.yml
owilson-os Nov 5, 2018
2aba68d
Added back inputs ready for fixing numpy patching
owilson-os Nov 5, 2018
84184ea
Added -x64 to conda versions so it doesn't use x32
oew1v07 Nov 5, 2018
7c11038
Merge branch 'master' of https://github.com/recipy/recipy
oew1v07 Nov 5, 2018
abacce2
Clarified if statement in appveyor and created an environment yml for…
owilson-os Nov 6, 2018
12db95d
Trying to fix appveyor by adding quotes
owilson-os Nov 6, 2018
3b8e120
Adding python version echo to troubleshoot
owilson-os Nov 6, 2018
fb512c1
Skipping python 2.7 for all keras tests
owilson-os Nov 7, 2018
8d65581
Trying to fix windows if statement
owilson-os Nov 7, 2018
9fd7057
Added mistakenly deleted quotes and more read outs
owilson-os Nov 7, 2018
af3f04a
Added quotes to python version in appveyor.yml to see if that works
owilson-os Nov 7, 2018
323d9fb
Removed quotes from appveyor config and added RDP for diagnosis@
owilson-os Nov 14, 2018
f5166da
Removed python 2.7 and 3.4 for the time being and removed password fo…
oew1v07 Nov 14, 2018
80bfe4c
Put on finish condition at end
oew1v07 Nov 14, 2018
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 6 additions & 1 deletion .travis.yml
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,13 @@ install:
nibabel
gdal imageio tifffile xarray rasterio netCDF4
iris
joblib
- source activate test-environment
# Install packages conditionally depending on python version
- if [[ ("$TRAVIS_PYTHON_VERSION" == "2.7" ) || ( "$TRAVIS_PYTHON_VERSION" == "3.5" ) || ( "$TRAVIS_PYTHON_VERSION" == "3.6" ) ]];
then
conda install tensorflow keras>=2.2.4;
fi
# Copy matplotlib configuration so it does not try and plot to
# screen, which can cause matplotlib tests to fail.
- cp integration_test/packages/matplotlibrc .
Expand All @@ -57,7 +63,6 @@ install:
- python -c "import sys, pprint; pprint.pprint(sys.path)"
- python -c "import tinydb"


script:
# Run py.test with 'v' (verbose) to show test function names and
# 'rs' to show reasons for skipped tests
Expand Down
32 changes: 24 additions & 8 deletions appveyor.yml
Original file line number Diff line number Diff line change
@@ -1,16 +1,15 @@
build: false

environment:

matrix:
- PYTHON_VERSION: 2.7
MINICONDA: C:\Miniconda
- PYTHON_VERSION: 3.4
MINICONDA: C:\Miniconda3
# - PYTHON_VERSION: 2.7
# MINICONDA: C:\Miniconda-x64
# - PYTHON_VERSION: 3.4
# MINICONDA: C:\Miniconda3-x64
- PYTHON_VERSION: 3.5
MINICONDA: C:\Miniconda3
MINICONDA: C:\Miniconda3-x64
- PYTHON_VERSION: 3.6
MINICONDA: C:\Miniconda3
MINICONDA: C:\Miniconda3-x64

init:
- "ECHO %PYTHON_VERSION% %MINICONDA%"
Expand Down Expand Up @@ -39,8 +38,22 @@ install:
scikit-image
nibabel
gdal imageio tifffile xarray rasterio netCDF4
iris"
iris
joblib"
- activate test-environment
# Install dependencies for keras if the python version allows it
# If statement error suggests that python version and temp var might be
# empty - this checks that it isn't
- ECHO %PYTHON_VERSION%
- set TEMP_VAR=0
- IF %PYTHON_VERSION%==3.5 set TEMP_VAR=1
- IF %PYTHON_VERSION%==3.6 set TEMP_VAR=1
- ECHO %TEMP_VAR%
- IF %TEMP_VAR%==1 (
conda install tensorflow keras>=2.2.4 pytables
) else (
ECHO Not installing keras.
)
# Copy matplotlib configuration so it does not try and plot to
# screen, which can cause matplotlib tests to fail.
- copy integration_test\packages\matplotlibrc .
Expand All @@ -58,3 +71,6 @@ test_script:
# Run py.test with 'v' (verbose) to show test function names and
# 'rs' to show reasons for skipped tests
- py.test -v -rs integration_test

on_finish:
- ps: $blockRdp = $true; iex ((new-object net.webclient).DownloadString('https://raw.githubusercontent.com/appveyor/ci/master/scripts/enable-rdp.ps1'))
25 changes: 25 additions & 0 deletions integration_test/config/test_packages.yml
Original file line number Diff line number Diff line change
Expand Up @@ -293,3 +293,28 @@ test_cases:
inputs: [ cube1.nc ]
- arguments: [ save ]
outputs: [ cube.nc ]
---
script: run_keras.py
libraries: [ keras ]
test_cases:
- arguments: [ datagenerator_flowdirectory ]
inputs: [ keras ]
skip_py_version: [ 2.7, 3.4, 3.7 ]
- arguments: [ saveweights ]
inputs: ['mnist.npz']
outputs: [ Model_Weights_test.h5 ]
skip_py_version: [ 2.7, 3.4, 3.7 ]
- arguments: [ savemodel ]
inputs: ['mnist.npz']
outputs: [ Whole_Model_test.h5 ]
skip_py_version: [ 2.7, 3.4, 3.7 ]
- arguments: [ callback_saveweights ]
inputs: ['mnist.npz']
outputs: [ model_01.hdf5, model_02.hdf5 ]
skip_py_version: [ 2.7, 3.4, 3.7 ]
- arguments: [ loadweights ]
inputs: [ Model_Weights.h5 ]
skip_py_version: [ 2.7, 3.4, 3.7 ]
- arguments: [ loadmodel ]
inputs: [ Whole_Model.h5 ]
skip_py_version: [ 2.7, 3.4, 3.7 ]
Binary file not shown.
Binary file not shown.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added integration_test/packages/data/keras/mnist.npz
Binary file not shown.
Loading