Academia.eduAcademia.edu

Outline

Tone-Mapping Using Perceptual-Quantizer and Image Histogram

IEEE Access

https://doi.org/10.1109/ACCESS.2020.2973273

Abstract

A new tone-mapping algorithm is presented for visualization of high dynamic range (HDR) images on low dynamic range (LDR) displays. In the first step, the real-world pixel intensities of the HDR image are transformed to a perceptual domain using the perceptual-quantizer (PQ). This is followed by construction of the histogram of the luminance channel. Tone-mapping curve is generated from the cumulative histogram. It is known that histogram-based tone-mapping approaches can lead to excessive stretching of contrast in highly populated bins, whereas the pixels in sparse bins can suffer from excessive compression of contrast. We handle these issues by restricting the pixel counts in the histogram to remain below a defined limit, determined by a uniform distribution model. The proposed method is compared with state-of-the-art algorithms, using some well-known metrics that quantify the quality of tone-mapped images, and is found to have the best performance. INDEX TERMS Image enhancement, high dynamic range imaging, tone-mapping, image visualization.

References (35)

  1. G. W. Larson, H. Rushmeier, and C. Piatko, ''A visibility matching tone reproduction operator for high dynamic range scenes,'' IEEE Trans. Vis. Comput. Graph., to be published, doi: 10.1109/2945.646233.
  2. A. Husseis, A. Mokraoui, and B. Matei, ''Revisited histogram equal- ization as HDR images tone mapping operators,'' in Proc. IEEE Int. Symp. Signal Process. Inf. Technol. (ISSPIT), Dec. 2017, pp. 144-149, doi: 10.1109/ISSPIT.2017.8388632.
  3. J. Duan, M. Bressan, C. Dance, and G. Qiu, ''Tone-mapping high dynamic range images by novel histogram adjustment,'' Pattern Recognit., vol. 43, no. 5, pp. 1847-1862, May 2010, doi: 10.1016/j.patcog.2009.12.006.
  4. A. Boschetti, N. Adami, R. Leonardi, and M. Okuda, ''High dynamic range image tone mapping based on local histogram equalization,'' in Proc. IEEE Int. Conf. Multimedia Expo, Jul. 2010, pp. 1130-1135, doi: 10.1109/ICME.2010.5583305.
  5. I. R. Khan, S. Rahardja, M. M. Khan, M. M. Movania, and F. Abed, ''A tone-mapping technique based on histogram using a sensitivity model of the human visual system,'' IEEE Trans. Ind. Electron., vol. 65, no. 4, pp. 3469-3479, Apr. 2018, doi: 10.1109/tie.2017.2760247.
  6. N. H. Nguyen, T. Van Vo, Y. Jeong, Y. Moon, and C. Lee, ''Opti- mized tone mapping of HDR images via HVS model-based 2D histogram equalization,'' in Proc. Asia-Pacific Signal Inf. Process. Assoc. Annu. Summit Conf. (APSIPA ASC), Nov. 2018, pp. 700-704, doi: 10.23919/APSIPA.2018.8659452.
  7. J. Han, I. R. Khan, and S. Rahardja, ''Lighting condition adaptive tone mapping method,'' in Proc. ACM SIGGRAPH Posters, 2018, pp. 37:1-37:2, doi: 10.1145/3230744.3230773.
  8. T. Scheuermann and J. Hensley. (2007). Efficient Histogram Generation Using Scattering on GPUs. [Online]. Available: https://developer.amd.com
  9. P. Ambalathankandy, ''An adaptive global and local tone mapping algo- rithm implemented on FPGA,'' IEEE Trans. Circuits Syst. Video Technol., to be published, doi: 10.1109/TCSVT.2019.2931510.
  10. M. Qiao and M. K. Ng, ''Tone mapping for high-dynamic-range images using localized gamma correction,'' J. Electron. Imag., vol. 24, no. 1, Jan. 2015, Art. no. 013010, doi: 10.1117/1.jei.24.1.013010.
  11. J. Lee, R.-H. Park, and S. Chang, ''Tone mapping using color correction function and image decomposition in high dynamic range imaging,'' IEEE Trans. Consum. Electron., vol. 56, no. 4, pp. 2772-2780, Nov. 2010, doi: 10.1109/tce.2010.5681168.
  12. R. Mantiuk, S. Daly, L. Kerofsky, R. Mantiuk, S. Daly, and L. Kerofsky, ''Display adaptive tone mapping,'' in Proc. ACM (SIGGRAPH), 2008, vol. 27, no. 3, p. 1, doi: 10.1145/1399504.1360667.
  13. D.-H. Lee, M. Fan, S.-W. Kim, M.-C. Kang, and S.-J. Ko, ''High dynamic range image tone mapping based on asymmetric model of retinal adapta- tion,'' Signal Process., Image Commun., vol. 68, pp. 120-128, Oct. 2018, doi: 10.1016/j.image.2018.07.008.
  14. X. Wu, ''A linear programming approach for optimal contrast-tone map- ping,'' IEEE Trans. Image Process., vol. 20, no. 5, pp. 1262-1272, May 2011, doi: 10.1109/tip.2010.2092438.
  15. T. Dobashi, M. Iwahashi, and H. Kiya, ''A fixed-point local tone map- ping operation for HDR images,'' in Proc. Eur. Signal Process. Conf., Nov. 2016, pp. 933-937, doi: 10.1109/EUSIPCO.2016.7760385.
  16. Z. Liang, J. Xu, D. Zhang, Z. Cao, and L. Zhang, ''A hybrid l1-l0 layer decomposition model for tone mapping,'' in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Jun. 2018, pp. 4758-4766, doi: 10.1109/CVPR.2018.00500.
  17. A. Rana, P. Singh, G. Valenzise, F. Dufaux, N. Komodakis, and A. Smolic, ''Deep tone mapping operator for high dynamic range images,'' IEEE Trans. Image Process., vol. 29, pp. 1285-1298, 2020, doi: 10.1109/tip.2019.2936649.
  18. T. O. Aydın, R. Mantiuk, and H.-P. Seidel, ''Extending quality metrics to full luminance range images,'' Proc. SPIE, Hum. Vis. Electron. Imag. XIII, vol. 6806, Mar. 2008, Art. no. 68060B, doi: 10.1117/12.765095.
  19. F. Durand and J. Dorsey, ''Interactive tone mapping,'' in Rendering Tech- niques. Vienna, Austria: Springer, 2000, pp. 219-230.
  20. F. Hassan and J. E. Carletta, ''An FPGA-based architecture for a local tone-mapping operator,'' J. Real-Time Image Process., vol. 2, no. 4, pp. 293-308, Dec. 2007, doi: 10.1007/s11554-007-0056-7.
  21. A. Benoit, D. Alleysson, J. Herault, and P. Le Callet, ''Spatio-temporal tone mapping operator based on a retina model,'' in Proc. Int. Workshop Comput. Color Imag. Berlin, Germany: Springer, Mar. 2009, pp. 12-22.
  22. F. Drago, W. L. Martens, K. Myszkowski, and N. Chiba, ''Design of a tone mapping operator for high-dynamic range images based upon psychophys- ical evaluation and preference mapping,'' Proc. SPIE, Hum. Vis. Electron. Imag. VIII, vol. 5007, pp. 321-331, Jun. 2003, doi: 10.1117/12.473919.
  23. I. R. Khan, ''Two layer scheme for encoding of high dynamic range images,'' in Proc. IEEE Int. Conf. Acoust., Speech Signal Process. (ICASSP), Mar. 2008, pp. 1169-1172, doi: 10.1109/ICASSP. 2008.4517823.
  24. K. Kim, J. Bae, and J. Kim, ''Natural HDR image tone mapping based on retinex,'' IEEE Trans. Consum. Electron., vol. 57, no. 4, pp. 1807-1814, Nov. 2011, doi: 10.1109/tce.2011.6131157.
  25. J. Ok and C. Lee, ''HDR tone mapping algorithm based on difference compression with adaptive reference values,'' J. Vis. Commun. Image Represent., vol. 43, pp. 61-76, Feb. 2017, doi: 10.1016/j.jvcir.2016.12.008.
  26. X. Shu and X. Wu, ''Locally adaptive rank-constrained optimal tone mapping,'' TOGACM Trans. Graph., vol. 37, no. 3, pp. 1-10, Jul. 2018, doi: 10.1145/3225219.
  27. E. Reinhard, G. Ward, S. Pattanaik, and P. Debevec, High Dynamic Range Imaging: Acquisition, Display and Image-Based Lighting, 2nd ed. San Mateo, CA, USA: Morgan Kaufmann, 2010.
  28. Y. Salih, W. B. Md-Esa, A. S. Malik, and N. Saad, ''Tone mapping of HDR images: A review,'' in Proc. Int. Conf. Intell. Adv. Syst., Jun. 2012, pp. 368-373, doi: 10.1109/ICIAS.2012.6306220.
  29. G. Eilertsen, R. K. Mantiuk, and J. Unger, ''A comparative review of tone-mapping algorithms for high dynamic range video,'' Comput. Graph. Forum, vol. 36, no. 2, pp. 565-592, May 2017, doi: 10.1111/cgf.13148.
  30. M. Kumar, B. Chourasia, and Y. Kurmi, ''High dynamic range image anal- ysis through various tone mapping techniques,'' Int. J. Control Automat., vol. 153, no. 11, pp. 14-17, Nov. 2016.
  31. E. Reinhard, M. Stark, P. Shirley, and J. Ferwerda, ''Photographic tone reproduction for digital images,'' ACM Trans. Graph., vol. 21, no. 3, pp. 267-276, 2002, doi: 10.1145/566654.566575.
  32. H. Yeganeh and Z. Wang, ''Objective quality assessment of tone-mapped images,'' IEEE Trans. Image Process., vol. 22, no. 2, pp. 657-667, Feb. 2013, doi: 10.1109/tip.2012.2221725.
  33. H. Z. Nafchi, A. Shahkolaei, R. F. Moghaddam, and M. Cheriet, ''FSITM: A feature similarity index for tone-mapped images,'' IEEE Signal Process. Lett., vol. 22, no. 8, pp. 1026-1029, Aug. 2015, doi: 10.1109/lsp.2014.2381458.
  34. M. D. Fairchild, ''The HDR photographic survey,'' in Proc. Color Imag. Conf., 2007, vol. 2007, no. 1, pp. 233-238.
  35. F. Banterle. GitHub-Banterle/HDR_Toolbox: HDR Toolbox for Pro- cessing High Dynamic Range (HDR) Images Into MATLAB and Octave. Accessed: Apr. 22, 2019. [Online]. Available: https://github.com/ banterle/HDR_Toolbox ISHTIAQ RASOOL KHAN received the B.Sc. degree in electrical engineering from the University of Engineering and Technology, Taxila, Pakistan, in 1992, the M.S. degree in sys- tems engineering from Quaid-i-Azam University, Islamabad, Pakistan, in 1994, and the M.S. degree in information engineering and the Ph.D. degree in digital signal processing from Hokkaido Uni- versity, Japan, in 1998 and 2000 respectively. He worked at the University of Kitakyushu, Japan, Kyushu Institute of Technology, Japan, Kitakyushu Foundation for the Advancement of Industry, Science and Technology, Japan, Institute for Info- comm Research, A * STAR, Singapore, and the King Abdulaziz University, Saudi Arabia. He is currently a Professor with the College of Computer Science and Engineering, University of Jeddah. His research interests include high-dynamic range imaging, medical data analytics, and digital signal processing. He was a JSPS Fellow with Hokkaido University, Japan, from 2000 to 2002. WAJID AZIZ received the Ph.D. degree from the Pakistan Institute of Engineering and Applied Sci- ences (PIEAS), in 2006, and Ph.D. degree from the University of Leicester, U.K., in 2011. He started his career at the University of Azad Jammu & Kashmir (UAJ&K), in 1998, as a Lec- turer. He is currently serving as a Professor with the College of Computer Science and Engineering, University of Jeddah. His core research expertise are in biomedical information systems and his focused areas of research are biomedical signal processing, time series analy- sis and intelligent data analytics. He has published three books and more than 45 research articles in the reputed national and international journals and conference proceeding. Based on his academic and research contributions, he was a recipient of HEC University Best Teacher Award for the year from 2012 to 2013 by HEC Pakistan, in 2014 and the University Best Teacher Award by the University of AJ&K, in 2013. SEONG-O. SHIM received the B.S. degree in electronics engineering from Ajou University, Suwon, South Korea, in 1999, and the M.S. degree in mechatronics from the Gwangju Institute of Science and Technology, Gwangju, in 2001, and the Ph.D. degree in information and mechatronics from the Gwangju Institute of Science and Tech- nology, Gwangju, in 2011. was with LG Electronics DTV Labs, Seoul, Korea, working on research and development of digital TV, from 2003 to 2007. He is currently working as an Associate Professor at the College of Computer Science and Engineering, University of Jeddah, Jeddah, Saudi Arabia. His research interests include computer vision, image processing, 3D shape recovery, and medical imaging.