Bringing Texture to Your Flat Touchscreen

Bringing Texture to Your Flat Touchscreen

Model of ‘virtual bumps’ could lead to feeling a keyboard on your touchscreen

What if the touchscreen of your smartphone or tablet could touch you back?

What if touch was as integrated into our ubiquitous technology as sight and sound?

Northwestern University and Carnegie Mellon University researchers now report a fascinating discovery that provides insight into how the brain makes sense of data from fingers.

In a study of people drawing their fingers over a flat surface that has two “virtual bumps,” the research team is the first to find that, under certain circumstances, the subjects feel only one bump when there really are two.

Better yet, the researchers can explain why the brain comes to this conclusion.

Their new mathematical model and experimental results on “haptic illusions” could one day lead to flat-screen displays featuring active touch-back technology, such as making your touchscreen’s keyboard actually feel like a keyboard. Tactile information also could benefit the blind, users of dashboard technology in cars, players of video games and more.

“Touch is so important in our real world, but it is neglected in the digital world,” said J. Edward Colgate, an expert in touch-based (haptic) systems. He is the Allen and Johnnie Breed University Professor of Design at Northwestern’s McCormick School of Engineering and Applied Science.

We want to create something that will make touch a reality for people interacting with their screens, and this work is a step in that direction.”

Forces felt by the fingers as they travel along a flat surface can lead to the illusion that the surface actually contains bumps. This so-called “virtual bump illusion” is well known in the haptics field, Colgate said, and the researchers were able to make use of it.

“By leveraging the virtual bump illusion, we were able to design a meaningful experiment that shed light on the way the brain integrates information from multiple fingers,” Colgate said. “Our big finding was ‘collapse ‘ — the idea that separate bumps felt in separate fingers are nonetheless experienced as one bump if their separation happens to match that of the fingers.”


The study, which will be published the week of Feb. 9 by the Proceedings of the National Academy of Sciences (PNAS), is about how the brain makes sense of data from the fingers.

Colgate, the paper’s corresponding author, and longtime Northwestern haptics collaborator Michael A. Peshkin joined forces with Carnegie Mellon’s Roberta Klatzky to work on filling the digital world’s functional gap by enabling flat screens to engage the haptic perceptual system. This is known as “surface haptic” technology.

The research team’s experiment presented two virtual bumps, with the distance between them varying across trials, to subjects participating in the study. When bump and finger spacing were identical, subjects reported feeling two bumps as one. In this case, the brain thinks it is too coincidental that there should be two bumps at the same time, so it registers the bumps as one.

“How does your body and mind interpret something flat and ‘see’ it as having shape and texture?” said Klatzky, a world-renowned expert in cognitive psychology and haptic perception. “An important step toward effective surface haptics is to understand what kinds of stimulation might lead you to feel something other than uniform flatness when you touch the surface of your device. Our study contributes to this understanding.”

See also: Careful what you say: Your Samsung TV might be listening

Klatzky is the Charles J. Queenan Jr. Professor of Psychology and Human-Computer Interaction at Carnegie Mellon.

“Our findings will help us and other researchers figure out how to design haptic technology to produce certain tactile effects,” said Peshkin, a professor of mechanical engineering at the McCormick School. “Haptics — giving a feel to objects — just enhances the physicality of a person’s experience.”

Steven G. Manuel, the study’s first author and a Northwestern alumnus, developed the model of where the “illusion of protrusion” comes from. It describes how the brain constructs a mental depiction of the surface using sensory signals from two fingers as they explore a surface over time and space.

A critical feature of the model, and one found in theories of perception more generally, is that it assumes the brain is biased toward inferring causes rather than registering coincidences. In essence, as the fingers encounter forces while they explore a flat surface, the brain creates virtual bumpiness that is most consistent with the physical bumps that would produce the same sensations.


Disclaimer: CSGLOBE.Com is not responsible for the accuracy of news releases posted to CSGlobe by contributing institutions or for the use of any information through the CSGlobe system.

Find us here

Get news from the CSGLOBE in your inbox each weekday morning

The views and opinions expressed in this article are those of the authors/source and do not necessarily reflect the position of CSGLOBE or its staff.

Paid content

The Solar System You Know Was Wrong!

Our Model Of The Solar System Has Been Wrong This Entire Time! If you walk into any classroom today, and likely ever since you were...

Amazing New Fabric Will Power All Your Devices Using Only Sun and Wind

A new fabric with both solar and kinetic energy power generation capabilities may soon give your watch, cell phone, or laptop the juice it...

Can Solar Powered Floating Farms Provide Power For The World?

From an innovative company called Forward Thinking Architecture comes an incredible design for a sustainable farm that floats in the ocean. The vision for the...

What's New Today

Georgia House Votes To Allow Citizens To Abolish Police Departments In The State

The Georgia House backed an effort on Friday to dissolve the Glynn County Police Department and any...

Leaked CDC document contradicts Pence claim that U.S. coronavirus cases ‘have stabilized’

Even as Vice President Mike Pence wrote in a Wall Street Journal op-ed published Tuesday that coronavirus...

Five bombshells about Trump from Bolton ‘s book

Excerpts from former national security adviser John Bolton ’s book about his time in the Trump administration...

Don’t Listen to Fox. Here’s What’s Really Going On in Seattle’s Protest Zone.

It seems I live in a city undergoing a “totalitarian takeover” that will lead to “fascist outcomes”...


Ancient Paintings of UFO’s from 200 to 15.000 years ago

Ancient Paintings of UFO's Over the past 15,000 years UFOs have been clearly depicted in paintings from all around the world. This video features some...

Out of the Blue

OUT OF THE BLUE is widely considered one of the best documentary films ever made about UFOs and was directed by celebrated filmmakers James...

What Is Agenda 21? Depopulation of 95% of the World By 2030

Most people are unaware that one of the greatest threats to their freedom may be a United Nations program which plans to depopulate 95%...

The Solar System You Know Was Wrong!

Our Model Of The Solar System Has Been Wrong This Entire Time! If you walk into any classroom today, and likely ever since you were...

6 Terrifying New Weapons Police Are Using To Crush Protests

Conspiracy theorists’ worst fears were confirmed last month when the New York Post reported that the NYPD now maintains an undisclosed number of unmarked, military-grade...

NASA scientists say: Pluto is alive and strangely resembles Earth

Pluto has blue skies, they may not be as sunny as those on Earth but the sky on the dwarf planet is undoubtedly blue. The...

Living materials created by MIT, mimicking natural systems

Living materials created by MIT scientists can sense and respond to surrounding Living materials, created by MIT researchers are able to sense stimuli and react...

Syrian President Says US And Europe Created Refugee Crisis By Supporting Terrorism

In an interview this week, Syrian President Bashar Assad pointed out that the US and Europe are largely to blame for the refugee crisis...

Groundbreaking Lawsuit in the U.S. Could End Water Fluoridation Worldwide

The U.S. government, via the EPA and titans of polluting industry have gotten away with putting chemicals in our water that cause a “light lobotomy”...

Anonymous Strikes the Heart of the Empire — Takes Down U.S. Federal Reserve Bank

After announcing a global call to arms against the “corrupt global banking cartel,” the hacker collective known as Anonymous, in conjunction with numerous other...

New French Law Makes It Illegal To Contact Employees After Work Hours

The new “right to disconnect” law mandates that a company with 50 employees or more cannot email an employee after typical work hours. If you’ve...