Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Paper: Computational Resource Optimisation in Feature Selection under Class Imbalance Conditions #947

Open
wants to merge 122 commits into
base: 2024
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
122 commits
Select commit Hold shift + click to select a range
18b5847
all changes
AmadiGabriel Jun 8, 2024
3a7676c
Update main.md
AmadiGabriel Jun 8, 2024
a2bf6a3
Update main.md
AmadiGabriel Jun 8, 2024
74a8c06
Update myst.yml
AmadiGabriel Jun 8, 2024
7767e98
Create images
AmadiGabriel Jun 8, 2024
a4000cc
Update main.md
AmadiGabriel Jun 8, 2024
69efd33
remove images
AmadiGabriel Jun 8, 2024
e0989c4
one image
AmadiGabriel Jun 8, 2024
5fe3e62
Update main.md
AmadiGabriel Jun 8, 2024
076b9a7
resultspics
AmadiGabriel Jun 8, 2024
6b8397d
aMerge branch '2024' of https://github.com/AmadiGabriel/scipy_proceed…
AmadiGabriel Jun 8, 2024
578d3e8
Update main.md
AmadiGabriel Jun 8, 2024
6cbc868
Update myst.yml
AmadiGabriel Jun 8, 2024
45d3c1c
Update main.md
AmadiGabriel Jun 8, 2024
05f3cd5
Credit Notes myst.yml
AmadiGabriel Jun 9, 2024
62d8fa1
Update main.md
AmadiGabriel Jun 9, 2024
0ad5c85
Update main.md
AmadiGabriel Jun 9, 2024
fd29f61
Update myst.yml
AmadiGabriel Jun 9, 2024
de0fa7f
removed googlesholarID
AmadiGabriel Jun 9, 2024
c6a637b
Update myst.yml
AmadiGabriel Jun 9, 2024
301afc6
Update main.md
AmadiGabriel Jun 9, 2024
02b0181
Updated subfigures
AmadiGabriel Jun 9, 2024
eef3f3b
Update main.md
AmadiGabriel Jun 9, 2024
fa0fb5e
Update main.md
AmadiGabriel Jun 9, 2024
91505e2
updated all subfigures
AmadiGabriel Jun 9, 2024
5d6b503
Update main.md
AmadiGabriel Jun 9, 2024
b5a1677
Update main.md
AmadiGabriel Jun 9, 2024
c85a6b4
Update main.md
AmadiGabriel Jun 9, 2024
8b511a4
Update main.md
AmadiGabriel Jun 9, 2024
35058e2
Update main.md
AmadiGabriel Jun 9, 2024
e0c9f4e
check figure rendering
AmadiGabriel Jun 9, 2024
7cf8f4e
Update main.md
AmadiGabriel Jun 9, 2024
ef6c241
Update main.md
AmadiGabriel Jun 9, 2024
ad82f05
included datasets
AmadiGabriel Jun 9, 2024
260fd32
included classifiers previously omitted
AmadiGabriel Jun 9, 2024
ff5ea49
Update main.md
AmadiGabriel Jun 10, 2024
a22580a
time_plot
AmadiGabriel Jun 10, 2024
1537dad
Update myst.yml
AmadiGabriel Jun 10, 2024
33d4afe
Update main.md
AmadiGabriel Jun 10, 2024
b6240fd
Update main.md
AmadiGabriel Jun 10, 2024
5ab0272
Update main.md
AmadiGabriel Jun 10, 2024
5fa7e34
time_plot
AmadiGabriel Jun 10, 2024
f7128cc
Update main.md
AmadiGabriel Jun 10, 2024
f895673
Update main.md
AmadiGabriel Jun 10, 2024
d80481f
Update main.md
AmadiGabriel Jun 10, 2024
5a2bfb0
Update main.md
AmadiGabriel Jun 10, 2024
0b4a27a
Update main.md
AmadiGabriel Jun 10, 2024
9cf6fdc
Update main.md
AmadiGabriel Jun 10, 2024
59419e1
Update main.md
AmadiGabriel Jun 10, 2024
56a0059
Update main.md
AmadiGabriel Jun 10, 2024
62c52ae
Update main.md
AmadiGabriel Jun 10, 2024
6ddae55
Update main.md
AmadiGabriel Jun 10, 2024
1f78803
Update main.md
AmadiGabriel Jun 10, 2024
b88b4c1
Update main.md
AmadiGabriel Jun 10, 2024
821986a
Update main.md
AmadiGabriel Jun 10, 2024
8954ee9
Update main.md
AmadiGabriel Jun 10, 2024
d19aa20
Update main.md
AmadiGabriel Jun 10, 2024
e322bdf
updated figure numbering_sorting reference display
AmadiGabriel Jun 10, 2024
77352ee
Update main.md
AmadiGabriel Jun 10, 2024
29fd58e
Update mybib.bib
AmadiGabriel Jun 10, 2024
17349de
Update main.md
AmadiGabriel Jun 10, 2024
88cd96d
Update mybib.bib
AmadiGabriel Jun 10, 2024
75759e6
Update mybib.bib
AmadiGabriel Jun 10, 2024
69cca57
Update mybib.bib
AmadiGabriel Jun 10, 2024
bf5782e
Update myst.yml
AmadiGabriel Jun 10, 2024
0f0bfcd
Update myst.yml
AmadiGabriel Jun 10, 2024
84e9f85
Update main.md
AmadiGabriel Jun 10, 2024
9c69ee1
Update main.md
AmadiGabriel Jun 10, 2024
024c226
Update main.md
AmadiGabriel Jun 10, 2024
9fb3499
Update mybib.bib
AmadiGabriel Jun 10, 2024
a885764
Update main.md
AmadiGabriel Jun 18, 2024
b1bb724
Update main.md
AmadiGabriel Jun 18, 2024
8a66e3f
Update mybib.bib
AmadiGabriel Jun 18, 2024
6a7c9ac
Update mybib.bib
AmadiGabriel Jun 18, 2024
9672806
Update myst.yml
AmadiGabriel Jun 18, 2024
21ac417
Update main.md
AmadiGabriel Jun 18, 2024
7a1fe1f
Update mybib.bib
AmadiGabriel Jun 18, 2024
491a0ac
Update mybib.bib
AmadiGabriel Jun 18, 2024
ce7f1f6
Update mybib.bib
AmadiGabriel Jun 18, 2024
377f472
Update main.md
AmadiGabriel Jun 18, 2024
9c4f4aa
Update main.md
AmadiGabriel Jun 18, 2024
8b52c0d
Update mybib.bib
AmadiGabriel Jun 18, 2024
17ec1ac
table issues
AmadiGabriel Jun 18, 2024
e0fa34b
Update main.md
AmadiGabriel Jun 19, 2024
5c4cd40
Update pfi.py
AmadiGabriel Jun 19, 2024
3469631
Update pfi.py
AmadiGabriel Jun 19, 2024
8d14583
Update main.md
AmadiGabriel Jun 19, 2024
d87e165
Update pfi.py
AmadiGabriel Jun 19, 2024
c147e87
Update pfi.py
AmadiGabriel Jun 19, 2024
1ed8ed2
Update box_plots.py
AmadiGabriel Jun 19, 2024
1bdd706
Update pfi.py
AmadiGabriel Jun 19, 2024
1550c7a
Update main.md
AmadiGabriel Jun 19, 2024
351c53c
Update main.md
AmadiGabriel Jun 21, 2024
e8bd49d
Update main.md
AmadiGabriel Jul 3, 2024
ce1d7fa
merged fig2
AmadiGabriel Jul 3, 2024
b8c7fdc
Update main.md
AmadiGabriel Jul 3, 2024
edbadc5
Delete papers/amadi_udu/images/gsvs_cmap.png
AmadiGabriel Jul 3, 2024
cc3291e
Delete papers/amadi_udu/images/gsvs_hierclus.png
AmadiGabriel Jul 3, 2024
3db8513
Delete papers/amadi_udu/images/gsvs_hierclus_cmap.png
AmadiGabriel Jul 3, 2024
b1ba7d2
merged fig 2
AmadiGabriel Jul 3, 2024
9afc966
Update main.md
AmadiGabriel Jul 3, 2024
dadada1
Update main.md
AmadiGabriel Jul 3, 2024
290ce18
Delete papers/amadi_udu/images/rf_statlog_shuttle_feature_0.png
AmadiGabriel Jul 3, 2024
0834a43
Delete papers/amadi_udu/images/lgbm_statlog_shuttle_feature_0.png
AmadiGabriel Jul 3, 2024
97e98c9
Delete papers/amadi_udu/images/svm_statlog_shuttle_feature_0.png
AmadiGabriel Jul 3, 2024
1094652
updated fig5
AmadiGabriel Jul 3, 2024
cc7cf3b
Delete papers/amadi_udu/images/rf_census_income_feature_2.png
AmadiGabriel Jul 4, 2024
518003d
Delete papers/amadi_udu/images/lgbm_census_income_feature_2.png
AmadiGabriel Jul 4, 2024
32bc957
Delete papers/amadi_udu/images/svm_census_income_feature_2.png
AmadiGabriel Jul 4, 2024
83eb8b1
census_income_fig
AmadiGabriel Jul 4, 2024
faa1aa7
Update main.md
AmadiGabriel Jul 4, 2024
7ae07d4
Delete papers/amadi_udu/images/lgbm_bank_marketing_feature_5.png
AmadiGabriel Jul 4, 2024
4a338e2
Delete papers/amadi_udu/images/rf_bank_marketing_feature_5.png
AmadiGabriel Jul 4, 2024
fc20a80
Delete papers/amadi_udu/images/svm_bank_marketing_feature_5.png
AmadiGabriel Jul 4, 2024
1a31a8d
fig 5 updated
AmadiGabriel Jul 4, 2024
c3ef82e
Update main.md
AmadiGabriel Jul 4, 2024
acb9438
Update main.md
AmadiGabriel Jul 5, 2024
8e913d1
Update main.md
AmadiGabriel Jul 5, 2024
c146256
Update main.md
AmadiGabriel Jul 8, 2024
fed9158
Update main.md
AmadiGabriel Jul 8, 2024
ac265b5
Update main.md
AmadiGabriel Jul 8, 2024
dbd1e7b
Update main.md
AmadiGabriel Jul 8, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Binary file added papers/amadi_udu/banner.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
63 changes: 63 additions & 0 deletions papers/amadi_udu/codes/box_plots.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,63 @@
#!/usr/bin/env python
# coding: utf-8
# %%

# %%


import pandas as pd
import ast
import matplotlib.pyplot as plt
import numpy as np


# %%


#choose dataset and model from list
datasets = {0: 'census_income', 1: 'bank_marketing', 2: 'statlog_shuttle', 3: 'diabetes', 4:'gsvs', 5: 'cover_type'}
models= {0: 'lgbm', 1: 'rf', 2: 'svm'}

model = models[0]
dataset = datasets[0]


# %%


df = pd.read_csv(f'results/{model}/{model}_{dataset}_combined_importances.csv')
df['AUC'] = df['AUC'].apply(lambda x: ast.literal_eval(x))

number = 0
y_ticks = np.round(np.arange(0.1, 1.1, 0.1), 2).tolist()
xmin, xmax = round(min(min(df['AUC'])),2)-0.05, round(max(max(df['AUC'])),2)+0.1
for _ in range(int(df.shape[0]/10)):
f_no = df['Feature_ID'].iloc[0+number]
plt.figure()
df['AUC'].iloc[0+number:10+number].apply(lambda x: pd.Series(x)).T.boxplot(figsize=(7, 5), vert=False,
boxprops=dict(color='blue'),
medianprops=dict(color='green'),
flierprops=dict(marker='x', markersize=6, markeredgecolor='red'),
whiskerprops=dict(linestyle='--', dashes = (10, 5)))

plt.rc('font', family='Times New Roman')
plt.xlabel('Decrease in AUC',fontsize=14)
plt.ylabel('Sample Fractions',fontsize=14)
plt.yticks(ticks=np.arange(1, 11), labels=y_ticks)

plt.xlim([xmin, xmax])
plt.axvline(x=0, color='black', linestyle='-.')
plt.tick_params(axis='both', which='major', labelsize=14)
plt.grid(visible=True)
plt.tight_layout()
plt.savefig(f'results/{model}/{model}_{dataset}_feature_{f_no}.png', dpi=300, bbox_inches='tight')
plt.clf()
plt.close()
number += 10


# %%




45,212 changes: 45,212 additions & 0 deletions papers/amadi_udu/codes/datasets/bank_marketing.csv

Large diffs are not rendered by default.

48,843 changes: 48,843 additions & 0 deletions papers/amadi_udu/codes/datasets/census_income.csv

Large diffs are not rendered by default.

Loading
Loading