Skip to content

Integration tests for the visualisation commands. #356

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 79 commits into from
Closed

Integration tests for the visualisation commands. #356

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
79 commits
Select commit Hold shift + click to select a range
2cff6bf
Test visualisation of learning curves using CLI command the visualisa…
istefano82 May 18, 2019
dd60cfd
Test png and pdf saving of learning curves visualisations.
May 18, 2019
6bcbe7b
Remove the system call and module call for visualisation tests.
May 19, 2019
87947cf
Test saving of confusion matrix visualisations as pdf and png.
May 19, 2019
d4ea650
Test saving of compare model perfomance visualisations as pdf and png.
May 19, 2019
3cfc318
Test skeleton saving of compare model perfomance probvisualisations …
May 19, 2019
14a928e
Test generating and saving compare perfomance prob figures as pdf and…
istefano82 May 19, 2019
ee6fd6d
Test generating and saving compare perfomance pred figures as pdf and…
istefano82 May 19, 2019
47a6b74
Refactor some test names to reflect they are testing classifier compa…
istefano82 May 19, 2019
11d3408
Test generating and saving compare classifier performance from subset…
istefano82 May 19, 2019
7442e28
Test visualisation compare_classifiers_changing_k_output as pdf and png.
May 23, 2019
0a6e334
Test visualisation compare_classifiers_multimetric_output as pdf and …
May 23, 2019
e23654a
Test visualisation compare_classifiers_predictions_output as pdf and …
May 23, 2019
79f0e47
Refactor test suite to test pdf and png output in each test case.
istefano82 May 24, 2019
234f6a1
Refactor test to PEP8 standarts.
istefano82 May 24, 2019
1473d27
Refactor visualise confusion matrix to test both pdf and png outputs.
istefano82 May 24, 2019
c98a182
Refactor visualise compare performance to test both pdf and png outputs.
istefano82 May 24, 2019
3902cd0
Refactor visualise compare classifiers from prob to test both pdf and…
istefano82 May 24, 2019
01bb7e9
Refactor visualise compare classifiers from pred to test both pdf and…
istefano82 May 24, 2019
de999ec
Refactor test docstrings to describe the input parameters.
istefano82 May 24, 2019
f99c66b
Refactor visualise compare classifiers from subset to test both pdf a…
istefano82 May 24, 2019
6e541f3
Refactor visualise compare classifiers changing k to test both pdf an…
istefano82 May 24, 2019
fadec9d
Refactor visualise compare classifiers multiclass multimetric to test…
istefano82 May 24, 2019
bdaf103
Refactor visualise compare classifiers predictions to test both pdf a…
istefano82 May 24, 2019
ebd344c
Refactor visualise compare classifiers predictions distribution. to t…
istefano82 May 24, 2019
32546e9
Refactor visualise confidence treshholding to test both pdf and png o…
istefano82 May 24, 2019
0c6b5b9
Refactor visualise confidence treshholding data vs acc to test both p…
istefano82 May 24, 2019
9f149c1
Refactor visualise confidence treshholding data vs acc subset to test…
istefano82 May 24, 2019
fe01d4d
Refactor visualise confidence treshholding data vs acc subset per cl…
istefano82 May 24, 2019
43cc1f5
Refactor visualise confidence treshholding 2 threshholds 2d test both…
istefano82 May 24, 2019
1eb8399
Refactor visualise confidence treshholding 2 threshholds 3d test both…
istefano82 May 24, 2019
e3094c2
Split lines longer than 80 chars in the treshhold tests.
istefano82 May 24, 2019
864bcb2
Test visualise binary treshhold vs metric saves both pdf and png outp…
istefano82 May 25, 2019
16c9933
Test visualise roc curves saves both pdf and png outputs.
istefano82 May 25, 2019
dba7e8a
Test visualise roc curves from test statistics saves both pdf and png…
istefano82 May 25, 2019
b25c02a
Test visualise calibration_1_vs_all saves both pdf and png outputs.
istefano82 May 25, 2019
fe3686b
Test visualise calibration_multiclass saves both pdf and png outputs.
istefano82 May 25, 2019
5fee1be
Test visualise requency_vs_f1 saves both pdf and png outputs.
istefano82 May 25, 2019
c94e53c
Fix confidence_thresholding_2thresholds_2d typo causing the test to f…
istefano82 May 25, 2019
6f42291
Fix roc_curves_from_test_statistics test commands.
istefano82 May 25, 2019
25de733
Add field name to compare_classifiers_multiclass_multimetric commands…
istefano82 May 25, 2019
e779488
Refator test_png command to extend the test_pdf command list.
istefano82 May 25, 2019
d9f9d85
Add author detials to module docstring.
istefano82 May 25, 2019
497ecc5
Test visualisation of learning curves using CLI command the visualisa…
istefano82 May 18, 2019
bf3e25e
Test generating and saving compare perfomance prob figures as pdf and…
istefano82 May 19, 2019
b2df375
Test generating and saving compare perfomance pred figures as pdf and…
istefano82 May 19, 2019
f43b21a
Refactor some test names to reflect they are testing classifier compa…
istefano82 May 19, 2019
5f26612
Test generating and saving compare classifier performance from subset…
istefano82 May 19, 2019
6e14712
Refactor test suite to test pdf and png output in each test case.
istefano82 May 24, 2019
f2555e9
Refactor test to PEP8 standarts.
istefano82 May 24, 2019
f2ec8a8
Refactor visualise confusion matrix to test both pdf and png outputs.
istefano82 May 24, 2019
8779835
Refactor visualise compare performance to test both pdf and png outputs.
istefano82 May 24, 2019
0a7dbbf
Refactor visualise compare classifiers from prob to test both pdf and…
istefano82 May 24, 2019
acb27ce
Refactor visualise compare classifiers from pred to test both pdf and…
istefano82 May 24, 2019
0933c50
Refactor test docstrings to describe the input parameters.
istefano82 May 24, 2019
9750c76
Refactor visualise compare classifiers from subset to test both pdf a…
istefano82 May 24, 2019
908a550
Refactor visualise compare classifiers changing k to test both pdf an…
istefano82 May 24, 2019
c69e98a
Refactor visualise compare classifiers multiclass multimetric to test…
istefano82 May 24, 2019
3bbcbb9
Refactor visualise compare classifiers predictions to test both pdf a…
istefano82 May 24, 2019
87da962
Refactor visualise compare classifiers predictions distribution. to t…
istefano82 May 24, 2019
a1dbec9
Refactor visualise confidence treshholding to test both pdf and png o…
istefano82 May 24, 2019
27fa483
Refactor visualise confidence treshholding data vs acc to test both p…
istefano82 May 24, 2019
336b7be
Refactor visualise confidence treshholding data vs acc subset to test…
istefano82 May 24, 2019
563e934
Refactor visualise confidence treshholding data vs acc subset per cl…
istefano82 May 24, 2019
78f5c4e
Refactor visualise confidence treshholding 2 threshholds 2d test both…
istefano82 May 24, 2019
e0abb66
Refactor visualise confidence treshholding 2 threshholds 3d test both…
istefano82 May 24, 2019
84bc0ac
Split lines longer than 80 chars in the treshhold tests.
istefano82 May 24, 2019
cac0d22
Test visualise binary treshhold vs metric saves both pdf and png outp…
istefano82 May 25, 2019
187eeff
Test visualise roc curves saves both pdf and png outputs.
istefano82 May 25, 2019
f65326c
Test visualise roc curves from test statistics saves both pdf and png…
istefano82 May 25, 2019
2544874
Test visualise calibration_1_vs_all saves both pdf and png outputs.
istefano82 May 25, 2019
057bd56
Test visualise calibration_multiclass saves both pdf and png outputs.
istefano82 May 25, 2019
052167c
Test visualise requency_vs_f1 saves both pdf and png outputs.
istefano82 May 25, 2019
d7971cd
Fix confidence_thresholding_2thresholds_2d typo causing the test to f…
istefano82 May 25, 2019
e9cbad8
Fix roc_curves_from_test_statistics test commands.
istefano82 May 25, 2019
47c5a72
Add field name to compare_classifiers_multiclass_multimetric commands…
istefano82 May 25, 2019
e6feb63
Refator test_png command to extend the test_pdf command list.
istefano82 May 25, 2019
9fa52f2
Add author detials to module docstring.
istefano82 May 25, 2019
025e579
Merge branch 'viz_file_output_tests' of https://github.com/istefano82…
istefano82 May 28, 2019
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 3 additions & 2 deletions ludwig/visualize.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1144,7 +1144,7 @@ def confidence_thresholding_2thresholds_2d(

filename_template = None
if output_directory:
filename_tempalte = os.path.join(
filename_template = os.path.join(
output_directory,
'confidence_thresholding_2thresholds_2d_{}.' + file_format
)
Expand Down Expand Up @@ -2007,7 +2007,8 @@ def frequency_vs_f1(
title='{} F1 Score vs Frequency {}'.format(
model_name_name,
field
)
),
filename=filename
)


Expand Down
Loading