Skip to content

Commit 51be352

Browse files
committedOct 17, 2014
Merge pull request BVLC#1315 from sergeyk/master
Fixing finetune_flickr_style model reported accuracy.
2 parents a7c9adb + f2f0a7a commit 51be352

File tree

2 files changed

+9
-8
lines changed

2 files changed

+9
-8
lines changed
 

‎examples/finetune_flickr_style/readme.md

+3-3
Original file line numberDiff line numberDiff line change
@@ -53,7 +53,6 @@ Using a script, we will download a small subset of the data and split it into tr
5353
Writing train/val for 1939 successfully downloaded images.
5454

5555
This script downloads images and writes train/val file lists into `data/flickr_style`.
56-
With this random seed there are 1,557 train images and 382 test images.
5756
The prototxts in this example assume this, and also assume the presence of the ImageNet mean file (run `get_ilsvrc_aux.sh` from `data/ilsvrc12` to obtain this if you haven't yet).
5857

5958
We'll also need the ImageNet-trained model, which you can obtain by running `./scripts/download_model_binary.py models/bvlc_reference_caffenet`.
@@ -106,7 +105,8 @@ Now we can train! (You can fine-tune in CPU mode by leaving out the `-gpu` flag.
106105
I0828 22:23:17.438894 11510 solver.cpp:302] Test net output #0: accuracy = 0.2356
107106

108107
Note how rapidly the loss went down. Although the 23.5% accuracy is only modest, it was achieved in only 1000, and evidence that the model is starting to learn quickly and well.
109-
Once the model is fully fine-tuned on the whole training set over 100,000 iterations the final validation accuracy is 91.64%. This takes ~7 hours in Caffe on a K40 GPU.
108+
Once the model is fully fine-tuned on the whole training set over 100,000 iterations the final validation accuracy is 39.16%.
109+
This takes ~7 hours in Caffe on a K40 GPU.
110110

111111
For comparison, here is how the loss goes down when we do not start with a pre-trained model:
112112

@@ -155,7 +155,7 @@ Now try fine-tuning to your own tasks and data!
155155

156156
## Trained model
157157

158-
We provide a model trained on all 80K images, with final accuracy of 98%.
158+
We provide a model trained on all 80K images, with final accuracy of 39%.
159159
Simply do `./scripts/download_model_binary.py models/finetune_flickr_style` to obtain it.
160160

161161
## License

‎models/finetune_flickr_style/readme.md

+6-5
Original file line numberDiff line numberDiff line change
@@ -3,16 +3,17 @@ name: Finetuning CaffeNet on Flickr Style
33
caffemodel: finetune_flickr_style.caffemodel
44
caffemodel_url: http://dl.caffe.berkeleyvision.org/finetune_flickr_style.caffemodel
55
license: non-commercial
6-
sha1: 443ad95a61fb0b5cd3cee55951bcc1f299186b5e
7-
caffe_commit: 41751046f18499b84dbaf529f64c0e664e2a09fe
6+
sha1: b61b5cef7d771b53b0c488e78d35ccadc073e9cf
7+
caffe_commit: 737ea5e936821b5c69f9c3952d72693ae5843370
88
gist_id: 034c6ac3865563b69e60
99
---
1010

1111
This model is trained exactly as described in `docs/finetune_flickr_style/readme.md`, using all 80000 images.
12-
The final performance on the test set:
12+
The final performance:
1313

14-
I0903 18:40:59.211707 11585 caffe.cpp:167] Loss: 0.407405
15-
I0903 18:40:59.211717 11585 caffe.cpp:179] accuracy = 0.9164
14+
I1017 07:36:17.370688 31333 solver.cpp:228] Iteration 100000, loss = 0.757952
15+
I1017 07:36:17.370730 31333 solver.cpp:247] Iteration 100000, Testing net (#0)
16+
I1017 07:36:34.248730 31333 solver.cpp:298] Test net output #0: accuracy = 0.3916
1617

1718
## License
1819

0 commit comments

Comments
 (0)
Please sign in to comment.