Physics and emote design: Quantifying clarity in digital images

This new metric could improve analysis and decision-making in scientific and creative fields, potentially changing the way we understand and evaluate imaging structures. It has been tested on digital artwork and physical systems. The research is published in the journal Proceedings of the National Academy of Sciences.

Mathematically defining clarity in art

At the heart of the method is a simple approach inspired by the practice of several artists narrowing down to evaluate their work. Researchers have developed a high-level mathematical method to quantify the “sharpness” of digital images by measuring how sharp visual elements remain when blurred. This indicator bridges the gap between physics and art, providing a flexible analytical tool for scientific analysis and artistic creation of digital images.

The method involves blurring an image by randomly swapping adjacent pixels, and then comparing the original image to its blurred version. The researchers measured how much of the original structure remained intact, assigning a higher score to images with structural elements that were still identifiable even after blurring, and a zero score to images with a chaotic distribution of pixels or solid colors.

“In our study, we define ‘clarity’ as the resistance to blurring or structural degradation. In art, this definition is consistent with the common art practice of shrinking a canvas to assess the clarity of an artwork. In mathematics , clarity can be expressed as “color contrast and its spatial distribution,” explains Professor Eliot Fried, Head of the Mechanics and Materials Department. “

This metric preserves the color diversity of the image, even after image compression. It is versatile and can be used to analyze different images, detect structural changes in physical systems, and is consistent with color theory, which studies how colors interact and influence our perception. Essentially, it shows how much of the pattern in the image survives random changes.

“Artists are always experimenting with their technique and composition. The idea came to me while painting expressions. As an experimental physicist, I was inspired to create metrics that could measure artistic qualities such as clarity, balance, and harmony. “We hope these metrics will allow art researchers to try different works and report their findings in an objective, quantitative way,” said researcher and first author Dr. San To Chan.

In digital art, “emoticons” often describe small, expressive images or animations that express emotions, especially in online communities and streaming platforms.

Video games, Vtuber and emoticons

Based on their metrics, the researchers designed an emoticon for the video game Holo X Break. This practical application proves that their research is useful even in commercial art projects.

“I chose to play the role of virtual YouTuber (VTuber) Sakura Miko because I am ’35P’; a member of her fan base. We have previously animated her with several other 35Ps, on a billboard in Times Square, New York After showing up to celebrate her fifth anniversary, I thought it would be an exciting way to connect her as a fan to my professional experience as a scientist,” added Dr. Chen .

Outside of research, Dr. Chen is also a freelance artist, contributing to independent game development projects such as Holocure. This research provides a solid foundation for analysis by drawing on significant expertise through the inclusion of artworks by fellow artists.

Dr Chen and Professor Fried are exploring potential applications for their clarity index beyond its original scope. They believe their metrics can revolutionize art analysis. Just as an engine converts heat energy into mechanical work, an artist converts clarity into artistic qualities such as harmony, balance, and rhythm.

This thermodynamic perspective on art can help researchers understand the rationale behind certain creative decisions made by artists, providing useful knowledge for human artists to further refine their craft.