CrazyEngineers
  • Microsoft's Experimental Keyboard Recognises Gestures

    Satya Swaroop Dash

    Satya Swaroop Dash

    @satya-swaroop-YDeBJM
    Updated: Oct 26, 2024
    Views: 1.3K
    Microsoft’s research division has found a way by which PC users can enjoy gesture commands without involving intrusive hardware. Microsoft Research’s Type-Hover-Swipe keyboard gets its motion sensing capabilities from a 16 x 4 array of infrared proximity sensors placed within key spaces of a custom made 3D printed keyboard. The infrared sensor nodes are mounted on a printed circuit board and inserted between the keycap and into the silicon membrane. As compared to the Kinect sensor on the Xbox One that captures full HD resolution data, the sensors of Type-Hover-Swipe keyboard can capture only a miniscule 64 pixels. While 64 pixels might seem incredibly low resolution, it is enough to identify the number of fingers and their movement above the keyboard.

    Microsoft Research’s Type-Hover-Swipe keyboard Microsoft Research’s Type-Hover-Swipe keyboard 2 Microsoft Research’s Type-Hover-Swipe keyboard 1

    The Type-Hover-Swipe keyboard accumulates binary motion history image and intensity motion history image form a motion signature for every gesture. The system can perform operations such as swiping left and right, swiping up and down, zooming in and out in pictures and even controlling a car’s movements in a game. Microsoft says that in the future they will be able to able to refine this system to detect gestures even more accurately as they have found out that they can combine raw sensor data to the nearest neighbour data to generate groundtruth data in an offline process. Once they refine this technique they will be able to create full touch based experiences.

    Gesture based systems such as Leap motion controllers worked in their own ecosystem of apps, but Microsoft’s system works on the entire Windows ecosystem. The Type-Hover-Swipe keyboard will surely make using Windows 8 easier but we would like you not be ready with your money just yet as Microsoft Research products may or may not make their way into the market. For the meanwhile, you can have a take a look at the keyboard in action in this video below.


    Source: #-Link-Snipped-# via #-Link-Snipped-#
    0
    Replies
Howdy guest!
Dear guest, you must be logged-in to participate on CrazyEngineers. We would love to have you as a member of our community. Consider creating an account or login.
Replies
  • Sarathkumar Chandrasekaran

    MemberApr 30, 2014

    Nice innovation but what would be the cost of a keyboard which would be implemented with sensors?
    Are you sure? This action cannot be undone.
    Cancel
  • Dhananjay Harkare

    MemberApr 30, 2014

    Apple's <a href="https://www.crazyengineers.com/threads/apples-patent-suggests-surface-like-cover-with-multi-touch-keyboard-for-ipad.74117">Apple's Patent Suggests Surface-Like Cover With Multi-Touch Keyboard For iPad</a> also sounds familiar!
    Are you sure? This action cannot be undone.
    Cancel
  • Rajni Jain

    MemberApr 30, 2014

    Looks like this is a keyboard with integrated invisible mouse.

    Nice one, but I am just wondering what If I will just move my fingers randomly over the keyboard without actually aiming to perform any action?

    Keyboard will still sense something and do something on the system, which is not desired by user?
    Are you sure? This action cannot be undone.
    Cancel
Home Channels Search Login Register