-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathtrainer2.log
More file actions
62 lines (60 loc) · 14.9 KB
/
Copy pathtrainer2.log
File metadata and controls
62 lines (60 loc) · 14.9 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
[I 2026-04-05 09:55:10,733] A new study created in memory with name: no-name-77b317f0-1bc4-4e57-a05f-c50f5db0f6e3
[I 2026-04-05 09:55:11,183] Trial 0 finished with value: 0.7879892037786774 and parameters: {'n_estimators': 193, 'max_depth': 10, 'learning_rate': 0.15675617910766504, 'subsample': 0.7691735176119228, 'colsample_bytree': 0.8148244990382163}. Best is trial 0 with value: 0.7879892037786774.
[I 2026-04-05 09:55:11,927] Trial 1 finished with value: 0.7723346828609987 and parameters: {'n_estimators': 221, 'max_depth': 8, 'learning_rate': 0.02435983797812759, 'subsample': 0.8625110109450242, 'colsample_bytree': 0.8596447557578557}. Best is trial 0 with value: 0.7879892037786774.
[I 2026-04-05 09:55:12,214] Trial 2 finished with value: 0.7825910931174088 and parameters: {'n_estimators': 87, 'max_depth': 5, 'learning_rate': 0.18235241303181404, 'subsample': 0.8168238622840569, 'colsample_bytree': 0.6096105455684591}. Best is trial 0 with value: 0.7879892037786774.
[I 2026-04-05 09:55:12,683] Trial 3 finished with value: 0.7464237516869094 and parameters: {'n_estimators': 293, 'max_depth': 3, 'learning_rate': 0.1532712948374554, 'subsample': 0.5211924548271782, 'colsample_bytree': 0.9246630258921205}. Best is trial 0 with value: 0.7879892037786774.
[I 2026-04-05 09:55:12,947] Trial 4 finished with value: 0.7878542510121457 and parameters: {'n_estimators': 134, 'max_depth': 3, 'learning_rate': 0.09817087991237285, 'subsample': 0.5038998466682074, 'colsample_bytree': 0.509123969851049}. Best is trial 0 with value: 0.7879892037786774.
[I 2026-04-05 09:55:13,245] Trial 5 finished with value: 0.8036437246963561 and parameters: {'n_estimators': 108, 'max_depth': 7, 'learning_rate': 0.02423135266559899, 'subsample': 0.5123509472437315, 'colsample_bytree': 0.7594285701252584}. Best is trial 5 with value: 0.8036437246963561.
[I 2026-04-05 09:55:13,672] Trial 6 finished with value: 0.7515519568151147 and parameters: {'n_estimators': 252, 'max_depth': 8, 'learning_rate': 0.24345608858052256, 'subsample': 0.5835363027297671, 'colsample_bytree': 0.9623455648694729}. Best is trial 5 with value: 0.8036437246963561.
[I 2026-04-05 09:55:14,245] Trial 7 finished with value: 0.7825910931174089 and parameters: {'n_estimators': 283, 'max_depth': 9, 'learning_rate': 0.07119688166419191, 'subsample': 0.8591456840858368, 'colsample_bytree': 0.830384781783913}. Best is trial 5 with value: 0.8036437246963561.
[I 2026-04-05 09:55:14,884] Trial 8 finished with value: 0.7670715249662619 and parameters: {'n_estimators': 253, 'max_depth': 7, 'learning_rate': 0.012148691000300377, 'subsample': 0.9819047675484613, 'colsample_bytree': 0.9088529897219841}. Best is trial 5 with value: 0.8036437246963561.
[I 2026-04-05 09:55:15,283] Trial 9 finished with value: 0.7773279352226721 and parameters: {'n_estimators': 188, 'max_depth': 9, 'learning_rate': 0.112419788652617, 'subsample': 0.8068989899254557, 'colsample_bytree': 0.5470197541829123}. Best is trial 5 with value: 0.8036437246963561.
[I 2026-04-05 09:55:15,501] Trial 10 finished with value: 0.7827260458839406 and parameters: {'n_estimators': 69, 'max_depth': 5, 'learning_rate': 0.02694195985983792, 'subsample': 0.6569814060934004, 'colsample_bytree': 0.6996041686878307}. Best is trial 5 with value: 0.8036437246963561.
[I 2026-04-05 09:55:15,867] Trial 11 finished with value: 0.7932523616734143 and parameters: {'n_estimators': 140, 'max_depth': 10, 'learning_rate': 0.039501135609499, 'subsample': 0.6819283353786424, 'colsample_bytree': 0.7533601744748402}. Best is trial 5 with value: 0.8036437246963561.
[I 2026-04-05 09:55:16,237] Trial 12 finished with value: 0.7983805668016194 and parameters: {'n_estimators': 135, 'max_depth': 6, 'learning_rate': 0.03665481286257769, 'subsample': 0.6613426762879078, 'colsample_bytree': 0.725752686836715}. Best is trial 5 with value: 0.8036437246963561.
[I 2026-04-05 09:55:16,534] Trial 13 finished with value: 0.8036437246963561 and parameters: {'n_estimators': 119, 'max_depth': 6, 'learning_rate': 0.013354012781847375, 'subsample': 0.6108953247367352, 'colsample_bytree': 0.715241655776203}. Best is trial 5 with value: 0.8036437246963561.
[I 2026-04-05 09:55:16,806] Trial 14 finished with value: 0.7983805668016194 and parameters: {'n_estimators': 99, 'max_depth': 6, 'learning_rate': 0.0100105127710981, 'subsample': 0.5812883093500341, 'colsample_bytree': 0.6430484717256666}. Best is trial 5 with value: 0.8036437246963561.
[I 2026-04-05 09:55:17,007] Trial 15 finished with value: 0.7931174089068825 and parameters: {'n_estimators': 54, 'max_depth': 5, 'learning_rate': 0.01670377282867538, 'subsample': 0.5857328256617875, 'colsample_bytree': 0.7849215415293935}. Best is trial 5 with value: 0.8036437246963561.
[I 2026-04-05 09:55:17,485] Trial 16 finished with value: 0.7878542510121457 and parameters: {'n_estimators': 109, 'max_depth': 7, 'learning_rate': 0.018360604867613067, 'subsample': 0.7064213780544919, 'colsample_bytree': 0.666216643330287}. Best is trial 5 with value: 0.8036437246963561.
[I 2026-04-05 09:55:18,587] Trial 17 finished with value: 0.8086369770580296 and parameters: {'n_estimators': 168, 'max_depth': 4, 'learning_rate': 0.016103000368884672, 'subsample': 0.5565895660604171, 'colsample_bytree': 0.5981128937469652}. Best is trial 17 with value: 0.8086369770580296.
[I 2026-04-05 09:55:18,970] Trial 18 finished with value: 0.7931174089068826 and parameters: {'n_estimators': 169, 'max_depth': 4, 'learning_rate': 0.0388216250817825, 'subsample': 0.53979137615025, 'colsample_bytree': 0.5790365352001257}. Best is trial 17 with value: 0.8086369770580296.
[I 2026-04-05 09:55:19,417] Trial 19 finished with value: 0.7931174089068825 and parameters: {'n_estimators': 157, 'max_depth': 4, 'learning_rate': 0.05958420082717767, 'subsample': 0.6269296473763142, 'colsample_bytree': 0.6411701138371153}. Best is trial 17 with value: 0.8086369770580296.
[I 2026-04-05 09:55:19,851] Trial 20 finished with value: 0.7879892037786774 and parameters: {'n_estimators': 197, 'max_depth': 4, 'learning_rate': 0.024471156057287776, 'subsample': 0.7306326530399251, 'colsample_bytree': 0.7650625002446285}. Best is trial 17 with value: 0.8086369770580296.
[I 2026-04-05 09:55:20,215] Trial 21 finished with value: 0.8087719298245613 and parameters: {'n_estimators': 120, 'max_depth': 6, 'learning_rate': 0.015883733147513106, 'subsample': 0.559154289556329, 'colsample_bytree': 0.6800137511896991}. Best is trial 21 with value: 0.8087719298245613.
[I 2026-04-05 09:55:21,750] Trial 22 finished with value: 0.8190283400809717 and parameters: {'n_estimators': 84, 'max_depth': 7, 'learning_rate': 0.018006902608498226, 'subsample': 0.547031409725285, 'colsample_bytree': 0.6807037540677212}. Best is trial 22 with value: 0.8190283400809717.
[I 2026-04-05 09:55:22,242] Trial 23 finished with value: 0.8139001349527666 and parameters: {'n_estimators': 85, 'max_depth': 8, 'learning_rate': 0.0170235540118634, 'subsample': 0.555453751363953, 'colsample_bytree': 0.5854891812869571}. Best is trial 22 with value: 0.8190283400809717.
[I 2026-04-05 09:55:22,615] Trial 24 finished with value: 0.7878542510121457 and parameters: {'n_estimators': 78, 'max_depth': 8, 'learning_rate': 0.011296771301199424, 'subsample': 0.6287846568564078, 'colsample_bytree': 0.6787218071560556}. Best is trial 22 with value: 0.8190283400809717.
[I 2026-04-05 09:55:22,891] Trial 25 finished with value: 0.8086369770580297 and parameters: {'n_estimators': 61, 'max_depth': 9, 'learning_rate': 0.02016121439059619, 'subsample': 0.5546958707394313, 'colsample_bytree': 0.5484500009633566}. Best is trial 22 with value: 0.8190283400809717.
[I 2026-04-05 09:55:23,504] Trial 26 finished with value: 0.7878542510121458 and parameters: {'n_estimators': 89, 'max_depth': 8, 'learning_rate': 0.032576911106268334, 'subsample': 0.6148609005658291, 'colsample_bytree': 0.6302771330902899}. Best is trial 22 with value: 0.8190283400809717.
[I 2026-04-05 09:55:23,827] Trial 27 finished with value: 0.7773279352226721 and parameters: {'n_estimators': 50, 'max_depth': 7, 'learning_rate': 0.01384272184075641, 'subsample': 0.9953103462740517, 'colsample_bytree': 0.559893849679441}. Best is trial 22 with value: 0.8190283400809717.
[I 2026-04-05 09:55:25,619] Trial 28 finished with value: 0.7824561403508772 and parameters: {'n_estimators': 120, 'max_depth': 6, 'learning_rate': 0.05406649840060966, 'subsample': 0.9364011646658433, 'colsample_bytree': 0.5030723679096025}. Best is trial 22 with value: 0.8190283400809717.
[I 2026-04-05 09:55:26,041] Trial 29 finished with value: 0.8087719298245613 and parameters: {'n_estimators': 79, 'max_depth': 9, 'learning_rate': 0.019935960932762568, 'subsample': 0.5474767491610758, 'colsample_bytree': 0.6805383341379804}. Best is trial 22 with value: 0.8190283400809717.
[I 2026-04-05 09:55:26,626] Trial 30 finished with value: 0.7983805668016194 and parameters: {'n_estimators': 153, 'max_depth': 10, 'learning_rate': 0.03141610664537129, 'subsample': 0.7687898036463843, 'colsample_bytree': 0.8183949248256022}. Best is trial 22 with value: 0.8190283400809717.
[I 2026-04-05 09:55:26,949] Trial 31 finished with value: 0.8035087719298245 and parameters: {'n_estimators': 75, 'max_depth': 9, 'learning_rate': 0.019955187463058067, 'subsample': 0.5483235675237128, 'colsample_bytree': 0.6751547743765882}. Best is trial 22 with value: 0.8190283400809717.
[I 2026-04-05 09:55:27,346] Trial 32 finished with value: 0.8085020242914981 and parameters: {'n_estimators': 96, 'max_depth': 8, 'learning_rate': 0.015354473903281375, 'subsample': 0.5792368105568955, 'colsample_bytree': 0.717849199487846}. Best is trial 22 with value: 0.8190283400809717.
[I 2026-04-05 09:55:27,650] Trial 33 finished with value: 0.8191632928475034 and parameters: {'n_estimators': 84, 'max_depth': 8, 'learning_rate': 0.020973156336198524, 'subsample': 0.5028120628251169, 'colsample_bytree': 0.611961699773609}. Best is trial 33 with value: 0.8191632928475034.
[I 2026-04-05 09:55:28,015] Trial 34 finished with value: 0.8036437246963561 and parameters: {'n_estimators': 113, 'max_depth': 7, 'learning_rate': 0.027453231345364103, 'subsample': 0.515410540222708, 'colsample_bytree': 0.6061118840380437}. Best is trial 33 with value: 0.8191632928475034.
[I 2026-04-05 09:55:28,397] Trial 35 finished with value: 0.7985155195681511 and parameters: {'n_estimators': 93, 'max_depth': 8, 'learning_rate': 0.02146106162882593, 'subsample': 0.5155245417006395, 'colsample_bytree': 0.6257163792445148}. Best is trial 33 with value: 0.8191632928475034.
[I 2026-04-05 09:55:28,764] Trial 36 finished with value: 0.7932523616734143 and parameters: {'n_estimators': 125, 'max_depth': 7, 'learning_rate': 0.010357943448837802, 'subsample': 0.5007304701621259, 'colsample_bytree': 0.5876794264582362}. Best is trial 33 with value: 0.8191632928475034.
[I 2026-04-05 09:55:29,480] Trial 37 finished with value: 0.7982456140350876 and parameters: {'n_estimators': 65, 'max_depth': 8, 'learning_rate': 0.04820820288799889, 'subsample': 0.6020479321647187, 'colsample_bytree': 0.6525907926841701}. Best is trial 33 with value: 0.8191632928475034.
[I 2026-04-05 09:55:29,815] Trial 38 finished with value: 0.8191632928475034 and parameters: {'n_estimators': 83, 'max_depth': 6, 'learning_rate': 0.01468640771000231, 'subsample': 0.6587090919775126, 'colsample_bytree': 0.5393432678656547}. Best is trial 33 with value: 0.8191632928475034.
[I 2026-04-05 09:55:31,242] Trial 39 finished with value: 0.8242914979757086 and parameters: {'n_estimators': 102, 'max_depth': 7, 'learning_rate': 0.01275005845730702, 'subsample': 0.651702614818277, 'colsample_bytree': 0.527685292834269}. Best is trial 39 with value: 0.8242914979757086.
[I 2026-04-05 09:55:31,887] Trial 40 finished with value: 0.8086369770580296 and parameters: {'n_estimators': 216, 'max_depth': 5, 'learning_rate': 0.012866110597647059, 'subsample': 0.7216006815393159, 'colsample_bytree': 0.519373361701086}. Best is trial 39 with value: 0.8242914979757086.
[I 2026-04-05 09:55:32,310] Trial 41 finished with value: 0.8086369770580297 and parameters: {'n_estimators': 101, 'max_depth': 7, 'learning_rate': 0.014950800622078713, 'subsample': 0.526142049349995, 'colsample_bytree': 0.5363246827808292}. Best is trial 39 with value: 0.8242914979757086.
[I 2026-04-05 09:55:32,635] Trial 42 finished with value: 0.8191632928475034 and parameters: {'n_estimators': 83, 'max_depth': 8, 'learning_rate': 0.012256952957370101, 'subsample': 0.6497803681051468, 'colsample_bytree': 0.5678931247484168}. Best is trial 39 with value: 0.8242914979757086.
[I 2026-04-05 09:55:32,941] Trial 43 finished with value: 0.8033738191632928 and parameters: {'n_estimators': 68, 'max_depth': 7, 'learning_rate': 0.011829094553194157, 'subsample': 0.6554021619252762, 'colsample_bytree': 0.5683304493964919}. Best is trial 39 with value: 0.8242914979757086.
[I 2026-04-05 09:55:34,172] Trial 44 finished with value: 0.8086369770580297 and parameters: {'n_estimators': 86, 'max_depth': 6, 'learning_rate': 0.024281977475132503, 'subsample': 0.6807121337937011, 'colsample_bytree': 0.5166511894930804}. Best is trial 39 with value: 0.8242914979757086.
[I 2026-04-05 09:55:35,433] Trial 45 finished with value: 0.803373819163293 and parameters: {'n_estimators': 105, 'max_depth': 8, 'learning_rate': 0.012887483931045645, 'subsample': 0.6924028498265724, 'colsample_bytree': 0.5329898048605833}. Best is trial 39 with value: 0.8242914979757086.
[I 2026-04-05 09:55:38,284] Trial 46 finished with value: 0.7825910931174089 and parameters: {'n_estimators': 141, 'max_depth': 9, 'learning_rate': 0.09736143432426618, 'subsample': 0.6503691987347221, 'colsample_bytree': 0.6166070421704812}. Best is trial 39 with value: 0.8242914979757086.
[I 2026-04-05 09:55:39,099] Trial 47 finished with value: 0.8036437246963561 and parameters: {'n_estimators': 62, 'max_depth': 7, 'learning_rate': 0.011097784939799796, 'subsample': 0.8060532101740169, 'colsample_bytree': 0.5659895638610204}. Best is trial 39 with value: 0.8242914979757086.
[I 2026-04-05 09:55:39,777] Trial 48 finished with value: 0.7623481781376519 and parameters: {'n_estimators': 75, 'max_depth': 6, 'learning_rate': 0.1946217498609377, 'subsample': 0.7482073134805837, 'colsample_bytree': 0.8680647928774702}. Best is trial 39 with value: 0.8242914979757086.
[I 2026-04-05 09:55:40,202] Trial 49 finished with value: 0.8190283400809717 and parameters: {'n_estimators': 57, 'max_depth': 8, 'learning_rate': 0.014303577560614714, 'subsample': 0.6331250557119587, 'colsample_bytree': 0.532995136570293}. Best is trial 39 with value: 0.8242914979757086.
--- Starting Hyperparameter Optimization with Optuna ---
Best trial accuracy: 0.8243
Best parameters: {'n_estimators': 102, 'max_depth': 7, 'learning_rate': 0.01275005845730702, 'scale_pos_weight': np.float64(1.1685393258426966), 'random_state': 42, 'eval_metric': 'logloss', 'subsample': 0.651702614818277, 'colsample_bytree': 0.527685292834269}
Final Model Accuracy: 0.9180
ROC-AUC: 0.9589 | PR-AUC: 0.9258
Precision: 0.8710 | Recall: 0.9643 | F1: 0.9153
Brier Score: 0.0787
Preprocessor saved to models/preprocessor.joblib
Model, preprocessor, and metadata saved to models