Bringing Texture to Your Flat Touchscreen

Bringing Texture to Your Flat Touchscreen

Model of ‘virtual bumps’ could lead to feeling a keyboard on your touchscreen

What if the touchscreen of your smartphone or tablet could touch you back?

What if touch was as integrated into our ubiquitous technology as sight and sound?

Northwestern University and Carnegie Mellon University researchers now report a fascinating discovery that provides insight into how the brain makes sense of data from fingers.

In a study of people drawing their fingers over a flat surface that has two “virtual bumps,” the research team is the first to find that, under certain circumstances, the subjects feel only one bump when there really are two.

Better yet, the researchers can explain why the brain comes to this conclusion.

Their new mathematical model and experimental results on “haptic illusions” could one day lead to flat-screen displays featuring active touch-back technology, such as making your touchscreen’s keyboard actually feel like a keyboard. Tactile information also could benefit the blind, users of dashboard technology in cars, players of video games and more.

“Touch is so important in our real world, but it is neglected in the digital world,” said J. Edward Colgate, an expert in touch-based (haptic) systems. He is the Allen and Johnnie Breed University Professor of Design at Northwestern’s McCormick School of Engineering and Applied Science.

We want to create something that will make touch a reality for people interacting with their screens, and this work is a step in that direction.”

Forces felt by the fingers as they travel along a flat surface can lead to the illusion that the surface actually contains bumps. This so-called “virtual bump illusion” is well known in the haptics field, Colgate said, and the researchers were able to make use of it.

“By leveraging the virtual bump illusion, we were able to design a meaningful experiment that shed light on the way the brain integrates information from multiple fingers,” Colgate said. “Our big finding was ‘collapse ‘ — the idea that separate bumps felt in separate fingers are nonetheless experienced as one bump if their separation happens to match that of the fingers.”


The study, which will be published the week of Feb. 9 by the Proceedings of the National Academy of Sciences (PNAS), is about how the brain makes sense of data from the fingers.

Colgate, the paper’s corresponding author, and longtime Northwestern haptics collaborator Michael A. Peshkin joined forces with Carnegie Mellon’s Roberta Klatzky to work on filling the digital world’s functional gap by enabling flat screens to engage the haptic perceptual system. This is known as “surface haptic” technology.

The research team’s experiment presented two virtual bumps, with the distance between them varying across trials, to subjects participating in the study. When bump and finger spacing were identical, subjects reported feeling two bumps as one. In this case, the brain thinks it is too coincidental that there should be two bumps at the same time, so it registers the bumps as one.

“How does your body and mind interpret something flat and ‘see’ it as having shape and texture?” said Klatzky, a world-renowned expert in cognitive psychology and haptic perception. “An important step toward effective surface haptics is to understand what kinds of stimulation might lead you to feel something other than uniform flatness when you touch the surface of your device. Our study contributes to this understanding.”

See also: Careful what you say: Your Samsung TV might be listening

Klatzky is the Charles J. Queenan Jr. Professor of Psychology and Human-Computer Interaction at Carnegie Mellon.

“Our findings will help us and other researchers figure out how to design haptic technology to produce certain tactile effects,” said Peshkin, a professor of mechanical engineering at the McCormick School. “Haptics — giving a feel to objects — just enhances the physicality of a person’s experience.”

Steven G. Manuel, the study’s first author and a Northwestern alumnus, developed the model of where the “illusion of protrusion” comes from. It describes how the brain constructs a mental depiction of the surface using sensory signals from two fingers as they explore a surface over time and space.

A critical feature of the model, and one found in theories of perception more generally, is that it assumes the brain is biased toward inferring causes rather than registering coincidences. In essence, as the fingers encounter forces while they explore a flat surface, the brain creates virtual bumpiness that is most consistent with the physical bumps that would produce the same sensations.


Disclaimer: CSGLOBE.Com is not responsible for the accuracy of news releases posted to CSGlobe by contributing institutions or for the use of any information through the CSGlobe system.

Find us here

Get news from the CSGLOBE in your inbox each weekday morning

The views and opinions expressed in this article are those of the authors/source and do not necessarily reflect the position of CSGLOBE or its staff.

Paid content

The 10 Biggest Dangers Posed By Future Technology

It’s not easy predicting the future of technology. In the fifties it seemed a pretty much foregone conclusion that by 2015 we would all...

Government-Funded ‘Am I Stoned?’ Marijuana App Tells You: You’re Stoned

If you’ve ever wondered how stoned you are, take comfort in the fact that you’re not alone: Government officials are wondering the same thing. With...

This Man One Ups Tesla By Inventing An Electric Car That Never Needs Charging

The concept of the electric car has been around for a very long time, and as with any other world revolutionizing technology, it’s taken...

What's New Today

Georgia House Votes To Allow Citizens To Abolish Police Departments In The State

The Georgia House backed an effort on Friday to dissolve the Glynn County Police Department and any...

Leaked CDC document contradicts Pence claim that U.S. coronavirus cases ‘have stabilized’

Even as Vice President Mike Pence wrote in a Wall Street Journal op-ed published Tuesday that coronavirus...

Five bombshells about Trump from Bolton ‘s book

Excerpts from former national security adviser John Bolton ’s book about his time in the Trump administration...

Don’t Listen to Fox. Here’s What’s Really Going On in Seattle’s Protest Zone.

It seems I live in a city undergoing a “totalitarian takeover” that will lead to “fascist outcomes”...


What Is Agenda 21? Depopulation of 95% of the World By 2030

Most people are unaware that one of the greatest threats to their freedom may be a United Nations program which plans to depopulate 95%...

Russia Issues International ARREST WARRANT For ROTHSCHILD & SOROS!

Vladimir Putin, now in full control of Russia as Prime Minister (then) NOW President , wishes to build a strong Christian nation. In a...

Putin has Banned Rothschild and His New World Order Banking Cartel Family from Entering Russian Territory

As of recently, Russian president Vladimir Putin took yet another decision for his country. "Under any circumstances", the Rothschild family is banned from entering Russian territory. Along...

The 10 Biggest Dangers Posed By Future Technology

It’s not easy predicting the future of technology. In the fifties it seemed a pretty much foregone conclusion that by 2015 we would all...

Another Interesting Leak: A Second NASA Scientist Tells Us That ‘Somebody Else’ Is On The Moon

We live in a strange world, and as Neil Armstrong once said, there are “great ideas undiscovered, breakthroughs available to those who can remove...

Every Black Hole Contains Another Universe, Claims New Study

Quantum black hole study opens bridge to another universe In modern science, the prevailing opinion supposes that whatever falls into a black hole disappears forever...

Human Batteries – Superhuman Evolution?

Batteries Included Can you imagine being able to charge your cell phone just by walking, or power your iPod by eating and moving your jaw?...

Harvard Scientist Urges People to Stop Drinking “Low-Fat” and Sweetened Milk Immediately

For years, advertising campaigns have promoted the benefits of drinking milk. TV ads have sung milk’s praises, declaring that it supposedly increases everything from...

So It Begins: American Police Start Pushing to Weaponize Domestic Drones

Police are now voicing their concerns about domestic drone use — specifically, they want the option to be able to employ weaponized drones in...

For the First Time, Police Ask for Entire City’s Google Searches and the Court Says Yes

An Orwellian precedent is underway just outside of Minneapolis, Minnesota, which could be the downfall of internet freedom as we know it. Police in Edina, MN,...

Italian Court: Stealing Food Is Not A Crime If Person Is Desperately Hungry

Though enough food is presently produced on the planet to feed 10 people, and despite the fact that 795 million people go to bed...