Online hashing methods are receiving increasing attention in cross modal medical image retrieval research. However, existing online methods often lack the learning ability to maintain semantic correlation between new and existing data. To this end, we proposed online semantic similarity cross-modal hashing (OSCMH) learning framework to incrementally learn compact binary hash codes of medical stream data. Within it, a sparse representation of existing data based on online anchor datasets was designed to avoid semantic forgetting of the data and adaptively update hash codes, which effectively maintained semantic correlation between existing and arriving data and reduced information loss as well as improved training efficiency. Besides, an online discrete optimization method was proposed to solve the binary optimization problem of hash code by incrementally updating hash function and optimizing hash code on medical stream data. Compared with existing online or offline hashing methods, the proposed algorithm achieved average retrieval accuracy improvements of 12.5% and 14.3% on two datasets, respectively, effectively enhancing the retrieval efficiency in the field of medical images.
Citation：
LIU Qinghai, TANG Lun, WU Qianlin, XU Liming, CHEN Qianbin. Cross modal medical image online hash retrieval based on online semantic similarity. Journal of Biomedical Engineering, 2025, 42(2): 343-350. doi: 10.7507/1001-5515.202409022
Copy
Copyright © the editorial department of Journal of Biomedical Engineering of West China Medical Publisher. All rights reserved
| 1. |
|
| 2. |
|
| 3. |
Li X, Hu D, Nie F. Deep binary reconstruction for cross-modal hashing// Proceedings of the 25th ACM International Conference on Multimedia. California: ACM, 2017: 1398-1406.
|
| 4. |
Wang Y, Luo X, Xu X S. Label embedding online hashing for cross-modal retrieval// Proceedings of the 28th ACM International Conference on Multimedia. Seattle: ACM, 2020: 871-879.
|
| 5. |
|
| 6. |
|
| 7. |
Wang D, Wang Q, An Y, et al. Online collective matrix factorization hashing for large-scale cross-media retrieval// Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. Xi’an: ACM, 2020: 1409-1418.
|
| 8. |
Leng C, Wu J, Cheng J, et al. Online sketching hashing// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Boston: IEEE, 2015: 2503-2511.
|
| 9. |
Chen X, King I, Lyu M R. FROSH: FasteR online sketching hashing// Proceedings of the Uncertainty in Artificial Intelligence. Sydney: UAI, 2017: 89-101.
|
| 10. |
Zhou J, Ding G, Guo Y. Latent semantic sparse hashing for cross-modal similarity search// Proceedings of the 37th international ACM SIGIR Conference on Research & Development in Information Retrieval. Queensland: ACM, 2014: 415-424.
|
| 11. |
Chen J, Li Y, Lu H. Online self-organizing hashing// 2016 IEEE International Conference on Multimedia and Expo (ICME). Seattle: IEEE, 2016: 1-6.
|
| 12. |
|
| 13. |
|
| 14. |
|
| 15. |
|
| 16. |
Lin M, Ji R, Liu H, et al. Supervised online hashing via hadamard codebook learning// Proceedings of the 26th ACM International Conference on Multimedia. Seoul: ACM, 2018: 1635-1643.
|
| 17. |
|
| 18. |
|
| 19. |
|
| 20. |
Lu X, Zhu L, Cheng Z, et al. Online multi-modal hashing with dynamic query-adaption// Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. Paris: ACM, 2019: 715-724.
|
| 21. |
|
| 22. |
Ding G, Guo Y, Zhou J. Collective matrix factorization hashing for multimodal data// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Columbus: IEEE, 2014: 2075-2082.
|
| 23. |
Jiang Q Y, Li W J. Deep cross-modal hashing// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Honolulu: IEEE, 2017: 3232-3240.
|
| 24. |
|
| 25. |
|
| 26. |
|
- 1.
- 2.
- 3. Li X, Hu D, Nie F. Deep binary reconstruction for cross-modal hashing// Proceedings of the 25th ACM International Conference on Multimedia. California: ACM, 2017: 1398-1406.
- 4. Wang Y, Luo X, Xu X S. Label embedding online hashing for cross-modal retrieval// Proceedings of the 28th ACM International Conference on Multimedia. Seattle: ACM, 2020: 871-879.
- 5.
- 6.
- 7. Wang D, Wang Q, An Y, et al. Online collective matrix factorization hashing for large-scale cross-media retrieval// Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. Xi’an: ACM, 2020: 1409-1418.
- 8. Leng C, Wu J, Cheng J, et al. Online sketching hashing// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Boston: IEEE, 2015: 2503-2511.
- 9. Chen X, King I, Lyu M R. FROSH: FasteR online sketching hashing// Proceedings of the Uncertainty in Artificial Intelligence. Sydney: UAI, 2017: 89-101.
- 10. Zhou J, Ding G, Guo Y. Latent semantic sparse hashing for cross-modal similarity search// Proceedings of the 37th international ACM SIGIR Conference on Research & Development in Information Retrieval. Queensland: ACM, 2014: 415-424.
- 11. Chen J, Li Y, Lu H. Online self-organizing hashing// 2016 IEEE International Conference on Multimedia and Expo (ICME). Seattle: IEEE, 2016: 1-6.
- 12.
- 13.
- 14.
- 15.
- 16. Lin M, Ji R, Liu H, et al. Supervised online hashing via hadamard codebook learning// Proceedings of the 26th ACM International Conference on Multimedia. Seoul: ACM, 2018: 1635-1643.
- 17.
- 18.
- 19.
- 20. Lu X, Zhu L, Cheng Z, et al. Online multi-modal hashing with dynamic query-adaption// Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. Paris: ACM, 2019: 715-724.
- 21.
- 22. Ding G, Guo Y, Zhou J. Collective matrix factorization hashing for multimodal data// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Columbus: IEEE, 2014: 2075-2082.
- 23. Jiang Q Y, Li W J. Deep cross-modal hashing// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Honolulu: IEEE, 2017: 3232-3240.
- 24.
- 25.
- 26.
