Kinect for Windows SDK V1.7 发布

2013 年 3 月 18 日,微软对Kinect更新了SDK,目前的版本号已经到了1.7。

最新的SDK可以到开发者下载页面下载:Kinect Developer Downloads

新SDK中加入了对Press for Selection和Grip and Move for Scrolling手势的支持。

另外,对3D图像的重构也提供了相应的例子。

以下是新特性介绍的原文,出自http://msdn.microsoft.com/en-us/library/jj663803.aspx#SDK_1pt7

This release provides many new features, all part of the Developer Toolkit 1.7.0. The SDK/Runtime v1.7 will contain minor changes.

Introducing new Kinect Interactions

We’ve built a new Interactions framework which provides pre-packaged, reusable components that allow for even more exciting interaction possibilities. These components are supplied in both native and managed packages for maximum flexibility, and are also provided as a set of WPF controls. Among the new features are:

  • Press for Selection. This provides, along with the new KinectInteraction Controls, improved selection capability and faster interactions. If you’re familiar with previous Kinect for Windows interaction capabilities, this replaces the hover select concept.
  • Grip and Move for Scrolling. This provides, along with the new KinectInteraction Controls, 1-to-1 manipulation for more precise scrolling, as well as large fast scrolls with a fling motion. If you’re familiar with previous Kinect for Windows interaction capabilities, this replaces the hover scroll model.

New interactions work best with the following setup:

  • User stands 1.5 - 2.0 meters away from the sensor
  • Sensor mounted directly above or below the screen showing the application, and centered
  • Screen size < 46 inches
  • Avoid extreme tilt angles
  • As always, avoid lots of natural light and reflective materials for more reliable tracking

Engagement Model Enhancements

The Engagement model determines which user is currently interacting with the Kinect-enabled application.

This has been greatly enhanced to provide more natural interaction when a user starts interacting with the application, and particularly when the sensor detects multiple people. Developers can also now override the supplied engagement model as desired.

APIs, Samples, and DLL Details

A set of WPF interactive controls are provided to make it easy to incorporate these interactions into your applications.

Two samples use these controls: ControlsBasics-WPF and InteractionGallery-WPF. The controls can also be installed in source form via Toolkit Browser -> “Components” -> Microsoft.Kinect.Toolkit.Controls.

  • InteractionGallery - WPF uses the new KinectInteraction Controls in a customized app experience that demonstrates examples of navigation, engagement, article reading, picture viewing, video playback, and panning with grip. It was designed for 1920x1080 resolution screens in landscape layout. For those building applications with UI technologies other than WPF, the lower level InteractionStream APIs (native or managed) are available to build on top of. Native DLLs for InteractionStream are Kinect_Interaction170_32.dll and Kinect_Interaction170_64.dll under %KINECT_TOOLKIT_DIR%\Redist. Managed DLL for InteractionStream is Microsoft.Kinect.Toolkit.Interaction.dll found in%KINECT_TOOLKIT_DIR%\Assemblies.
  • There is no sample of InteractionStream API usage, however, Microsoft.Kinect.Toolkit.Controls source code (see info about controls samples above) is available and is a great example of using InteractionStream.

Kinect Fusion

KinectFusion provides 3D object scanning and model creation using a Kinect for Windows sensor. The user can paint a scene with the Kinect camera and simultaneously see, and interact with, a detailed 3D model of the scene. Kinect Fusion can be run at interactive rates on supported GPUs, and can run at non-interactive rates on a variety of hardware. Running at non-interactive rates may allow larger volume reconstructions.

Kinect Fusion Samples:

  • Kinect Fusion Basics - WPF, Kinect Fusion Basics - D2D: Demonstrates basic use of the Kinect Fusion APIs for 3D reconstruction.
  • Kinect Fusion Explorer - WPF, Kinect Fusion Explorer - D2D: Demonstrates advanced 3D reconstruction features of Kinect Fusion, allowing adjustment of many reconstruction parameters, and export of reconstructed meshes.

Kinect Fusion Tech Specs

Kinect Fusion can process data either on a DirectX 11 compatible GPU with C++ AMP, or on the CPU, by setting the reconstruction processor type during reconstruction volume creation. The CPU processor is best suited to offline processing as only modern DirectX 11 GPUs will enable real-time and interactive frame rates during reconstruction.

Minimum Hardware Requirements for GPU based reconstruction

DirectX 11 compatible graphics card.

Kinect Fusion has been tested on the the NVidia GeForce GTX560, and the AMD Radeon 6950. These cards, or higher end cards from the same product lines are expected to be able to run at interactive rates.

For those building applications with technologies other than WPF, the lower level Fusion APIs (native or managed) are available to build on top of. Native DLLs for Fusion are Kinect_Fusion170_32.dll and Kinect_Fusion170_64.dll under%KINECT_TOOLKIT_DIR%\Redist. Managed DLL for Fusion is Microsoft.Kinect.Toolkit.Fusion.dll found in%KINECT_TOOLKIT_DIR%\Assemblies.

Desktop PC with 3GHz (or better) multi-core processor and a graphics card with 2GB or more of dedicated on-board memory. Kinect Fusion has been tested for high-end scenarios on a NVidia GeForce GTX680 and AMD Radeon HD 7850.

Note: It is possible to use Kinect Fusion on laptop class GPU hardware, but this typically runs significantly slower than desktop-class hardware. In general, aim to process at the same frame rate as the Kinect sensor (30fps) to enable the most robust camera pose tracking.

Getting Started with Kinect Fusion (Important!)
  1. Ensure you have compatible hardware (see Tech Specs section above).
  2. Download and install the latest graphics display drivers for your GPU.

Kinect Sensor Chooser - native

The Kinect Sensor Chooser is a native component that allows simplified management of the Kinect Sensor lifetime, and an enhanced user experience when dealing with missing sensors, unpowered sensors, or sensors that get unplugged while an application is running. It provides similar capabilities to the KinectSensorChooser in the Microsoft.Kinect.Toolkit component. A NuiSensorChooserUI control is also provided for use in native applications. It provides a user experience similar to the managed KinectSensorChooserUI.

Introducing New Samples!

  • Controls Basics - WPF: Demonstrates the new KinectInteraction Controls, including hands-free button pressing and scrolling through large lists. This replaces the Basic Interactions sample from previous releases.
  • Interaction Gallery - WPF: Demonstrates basic interactions using the new KinectInteraction Controls.
  • KinectBridge with MATLAB Basics - D2D: Demonstrates how to do image processing with the Kinect sensor using MATLAB API.
  • KinectBridge with OpenCV Basics - D2D: Demonstrates how to do image processing with the Kinect sensor using OpenCV API.
  • Kinect Explorer - D2D: Demonstrates how to use the Kinect's ColorImageStream, DepthImageStream, SkeletonStream, and AudioSource with C++ and Direct2D. This replaces the SkeletalViewer C++ sample.
  • Kinect Fusion Basics - WPF, Kinect Fusion Basics - D2D: Demonstrates basic use of the Kinect Fusion APIs for 3D reconstruction.
  • Kinect Fusion Explorer - WPF, Kinect Fusion Explorer - D2D: Demonstrates advanced 3D reconstruction features of Kinect Fusion, allowing adjustment of many reconstruction parameters, and export of reconstructed meshes.

本文参与腾讯云自媒体分享计划,欢迎正在阅读的你也加入,一起分享。

发表于

我来说两句

0 条评论
登录 后参与评论

相关文章

来自专栏IT派

开源|人脸检测的C / C ++源代

人脸检测的C/C++源代码,曾发表于 OPENCV 的 MAILING LIST,主要是对OPENCV 3.1 版本发布的代码做了一些速度上的优化,并且解决了内...

43450
来自专栏CreateAMind

End-to-end Driving via Conditional Imitation Learning

Felipe Codevilla, Matthias Müller, Alexey Dosovitskiy, Antonio López, Vladlen Ko...

11310
来自专栏智能计算时代

IBM Watson提供的认知计算服务介绍

Cognitive Service Introduction Twitter:@huiwenhan Weibo:@huiwenhan Agenda Wats...

36880
来自专栏生信技能树

使用ESTIMATE来对转录组表达数据根据stromal和immune细胞比例估算肿瘤纯度

ESTIMATE (Estimation of STromal and Immune cells in MAlignant Tumor tissues usin...

75720
来自专栏linux驱动个人学习

高通Audio中ASOC的machine驱动

ASoC被分为Machine、Platform和Codec三大部分,其中的Machine驱动负责Platform和Codec之间的耦合以及部分和设备或板子特定的...

1.5K40
来自专栏Kubernetes

runC源码分析——cgroup

runC项目中,与cgroups相关的代码,都在目录 runc/libcontainer/cgroups/下,下面是其源码目录结构分析: ? 我们关注的主要内...

48560
来自专栏hbbliyong

WPF TreeView SelectedItemChanged called twice

How to avoid WPF TreeView SelectedItemChanged being called twice Very often, we...

11920
来自专栏xdecode

Java调用PDFBox打印自定义纸张PDF

打印对象 一份设置为A3纸张, 页面边距为(10, 10, 10, 10)mm的PDF文件. ? PageFormat  默认PDFPrintable无法设置页...

70750
来自专栏HansBug's Lab

1592: [Usaco2008 Feb]Making the Grade 路面修整

1592: [Usaco2008 Feb]Making the Grade 路面修整 Time Limit: 10 Sec  Memory Limit: 162...

28370
来自专栏专知

关于写论文说来简单但做起来难的三条建议

A few years ago, we prepared a series of workshops on writing research papers an...

29950

扫码关注云+社区

领取腾讯云代金券