Using Leap Motion (unofficial)

NOTE: IntuiLab no longer provides out-of-the-box support for the Leap Motion Controller. No additional features or bug fixes will be made nor support will be offered. We have open sourced our legacy support and posted it to GitHub. Feel free to contribute! This page is kept solely for those creating their own Leap Motion Controller support based on the code posted to GitHub.

    Introduction

    The Leap Motion Interface Assets enable you to control an IntuiFace experience using the Leap Motion Controller. IntuiFace provides a set of gestures and postures to trigger any action in your experience.

    NOTE:

    • Either Composer Essential, Premier or Enterprise is required to create and save experiences using the Leap Motion Controller. However, to preview Leap Motion Controller support, you can use any edition, including Composer Free. Composer Free users won't be able to save their work but they will be able to experiment with the Leap Motion Controller. Essential, Premier and Enterprise users can make and save any changes they wish.

    To use the Leap Motion Controller interfaces, you must first install the Leap Motion Software available on the Leap Motion web site. If Composer is running during installation of the Leap Motion software, you must exit and restart it for the changes to take effect.

    There are four available Leap Motion Interface Assets, accessible in the Select an interface panel:

    • Hand presence: detects hand entry and removal
    • Gestures: detects hand movements for swipe left/right and tap down
    • Rock-Paper-Scissors Postures : detects the classic hand postures for the rock-paper-scissors game
    • Finger Count Postures: detects the number of fingers from one to five on one hand

    Each Interface Asset is equipped with a Design Accelerator enabling you to verify that your Leap Motion Controller is properly detected. Insert a Leap Motion interface into your scene, double click on the newly created interface asset, then enter Play Mode.

    Here is some advice from Leap Motion for optimal use of the Controller:
    You must perform gestures and postures between 2.5 and 60 centimeters above the Leap (between 1 inch and 24 inches), otherwise the device will not recognize your hand. In addition, postures must be held at least 1 second to be detected.

    Hand Presence

    This Interface Asset detects when a hand enters or leaves the Leap Motion field of view

    presence.jpg

    Triggers

    • Hand Present --> a hand is detected
    • Hand Lost --> a hand is lost

    Gestures

    Detects swipe left, swipe right and tap down. Use left/right swipes to control scene-to-scene navigation or to move through a collection. Use the tap down gesture to, for example, open the collection item in focus.

    gestures.jpg

    Properties:

    • Enable Swipe Left Gesture
    • Enable Swipe Right Gesture
    • Enable Tap Gesture

    Triggers

    • Swipe Left Gesture detected --> a swipe left gesture is detected
    • Swipe Right Gesture detected --> a swipe right gesture is detected
    • Tap Down Gesture detected --> a tap down gesture is detected

    Rock-Paper-Scissors Postures

    This Interface Asset detects when the user is forming one of the three Rock, Paper & Scissors postures with his/her hand (see picture below).

    From these triggers you can call any IntuiFace action.

    rock.jpg

    Properties

    • Enable Rock Posture
    • Enable Paper Posture
    • Enable Scissors Posture

    Triggers

    Each "shape" (Rock, Paper, Scissors) has the 3 following triggers

    • Posture detected --> Raised when the posture is detected.
    • Posture detection in progress --> Raised when posture detection is in progress. You can bind its parameter to a Linear Gauge to see the progress.
    • Posture lost --> Raised when the posture is lost.

    Finger Count Postures

    This Interface Asset counts how many fingers the user is displaying.

    From these triggers you can call any IntuiFace action. For example, use it to determine which item in an asset flow you wish to put in focus.

    fingercount.jpg

    Properties

    • Enable Zero Posture
    • Enable One Posture
    • Enable Two Posture
    • Enable Three Posture
    • Enable Four Posture
    • Enable Five Posture

    Triggers

    Each "finger count" (from Zero to Five) has the 3 following triggers

    • Posture detected --> Raised when the posture is detected.
    • Posture detection in progress --> Raised when posture detection is in progress. You can bind its parameter to a Linear Gauge to see the progress.
    • Posture lost --> Raised when the posture is lost.

    Known Limitations

    • IntuiFace currently provides hand, gesture & posture detection. Pointing and direct manipulation with the fingers will be available in future versions.
    • If you put more than one Interface Asset of each type in your experience, only the original will be functional.