Skip to content

Releases: movidius/ncsdk

NCSDK v2.10.01.01

06 Feb 20:49
@nealvis nealvis
v2.10.01.01
1149ddc
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
Compare
Choose a tag to compare
NCSDK v2.10.01.01 Latest
Latest

============================================================

Movidius Neural Compute SDK Release Notes

V2.10.01 2019-01-27

============================================================

This is a 2.x release of the Intel NCSDK which is not backwards compatible with the 1.x releases of the Intel NCSDK. Please look at the documentation for differences in tools and APIs.

SDK Notes:

New features:

  1. TensorFlow SSD networks added.
  2. Multi threaded execution on device. The graph option NC_RW_GRAPH_EXECUTORS_NUM which was previously limited to values 1 or 2 for Myriad X based devices, but can now be set to any value in the range 1-4 inclusive. This value corresponds to the number of executor threads to be used on the device for the graph. Each executor thread will use the number of shaves specified in the graph file (via the -s option on the compiler command.) The number of executors times the number of shaves specified in the graph file can not exceed the total number of shaves on the device (12 for Myriad2 or 16 for MyriadX.) Does not apply to Myriad 2 based devices

Notable bug fixes:

  1. Force numpy 1.15 to avoid known issue with 1.16 release.
  2. Force scikit-image to >= 0.13.0 and <= 0.14.0 to address issue with 0.12 RPi.

API Notes:

  1. Apps written with NCAPI v1 are not compatible with this release and need to be migrated to NCAPI v2, refer to Migrating Applications from NCAPI v1 to NCAPI v2 for information about migrating apps to the new API.

Network Notes:

Caffe

Tested networks:

  1. AlexNet
  2. GoogLeNet v1
  3. MobileNet v1
  4. Resnet 18
  5. Resnet 50
  6. SqueezeNet v1.1
  7. SSD MobileNet v1
  8. Tiny Yolo v1
  9. VGG 16 (Configuration D)
  10. RefineDet (Hardware only, see erratum #21)

Untested networks that likely work:

  1. LeNet
  2. CaffeNet
  3. VGG (Sousmith VGG_A)
  4. Tiny Yolo v2

TensorFlow (r1.09)

Tested networks:

  1. Facenet based on inception-resnet-v1
  2. inception-v1
  3. inception-v2 (GoogLeNet v2)
  4. inception-v3
  5. inception-v4
  6. Inception ResNet v2
  7. Mobilenet_V1_1.0 variants:
    • MobileNet_v1_1.0_224
    • MobileNet_v1_1.0_192
    • MobileNet_v1_1.0_160
    • MobileNet_v1_1.0_128
    • MobileNet_v1_0.75_224
    • MobileNet_v1_0.75_192
    • MobileNet_v1_0.75_160
    • MobileNet_v1_0.75_128
    • MobileNet_v1_0.5_224
    • MobileNet_v1_0.5_192
    • MobileNet_v1_0.5_160
    • MobileNet_v1_0.5_128
    • MobileNet_v1_0.25_224
    • MobileNet_v1_0.25_192
    • MobileNet_v1_0.25_160
    • MobileNet_v1_0.25_128
  8. TinyYolo v2 via Darkflow tranformation
  9. VGG 16 (Configuration D)
  10. SSD Inception v2
  11. SSD Mobilenet v1
  12. SSD Mobilenet v2

Firmware Features in shaves:

  1. Convolutions
  • The following convolution cases have been extensively tested (for stride s): 1x1s1,3x3s1,5x5s1,7x7s1, 7x7s2, 7x7s4
  • Group convolution
  • Depth Convolution
  • Dilated convolution
  1. Max Pooling Radix NxM with Stride S (See erratum #15)
  2. Average Pooling: Radix NxM with Stride S, Global average pooling (See erratum #15)
  3. Local Response Normalization
  4. Relu, Relu-X, Prelu, Leaky-Relu (see erratum #6)
  5. Softmax
  6. Sigmoid
  7. Tanh (see erratum #6)
  8. Deconvolution
  9. Slice (in SW via crop layer)
  10. Scale
  11. ElmWise unit : supported operations - sum, prod, max
  12. Fully Connected Layers (limited support -- : see erratum #10)
  13. Reshape
  14. Flatten
  15. Power
  16. Crop (SW in ChannelMinor format only)
  17. ELU
  18. Batch Normalization (fused)
  19. L2 Normalization
  20. Input Layer

Firmware Features in NCEs

  1. Convolution
  2. Max Pooling Radix NxM with Stride S (See erratum #15)
  3. Average Pooling: Radix NxM with Stride S, Global average pooling
  4. Fully Connected Layers
  5. Relu, Relu-X, Prelu, Leaky-Relu
  6. Fused Non-overlapping pooling

Bug Fixes:

  1. Docker now works with multiple devices.

Errata:

  1. Python 2.7 is fully supported for making user applications, but only the helloworld_py example runs as-is in both python 2.7 and 3.5 due to dependencies on modules.
  2. Depth-wise convolution may not be supported if channel multiplier > 1.
  3. If working behind proxy, proper proxy settings must be applied for the installer to succeed.
  4. Although improved, the installer is known to take a long time on Raspberry Pi. Date/time must be correct for SDK installation to succeed on Raspberry Pi.
  5. Convolution may fail to find a solution for very large inputs.
  6. Depth-wise convolution is tested for 3x3 kernels.
  7. A TanH layer’s “top” & “bottom” blobs must have different names. This is different from a ReLU layer, whose “top” & “bottom” should be named the same as its previous layer.
  8. On upgrade from previous versions of SDK, the installer will detect if openCV 3.3.0 was installed, for example from http://github.com/movidius/ncappzoo/apps/stream_ty_gn/install-opencv-from_source.sh. For this release, the installer will prompt to uninstall this specific version of openCV. This is required for ssd-caffe to run correctly. After installation is complete, openCV 3.3.0 can be re-installed and the ssd-caffe will continue to function.
  9. The MTCNN network in the app zoo is showing unexpected behaviour for this release, and is being investigated. To use MTCNN, please use version 1.12.00 of SDK.
  10. For Caffe networks, although mvNCCheck shows per-pixel error for some metrics for mobilenet_v1_224 and hardware GoogLeNet, classification results are not impacted.
  11. Only Ubuntu 16.04 LTS is supported as a host OS for this release. Ubuntu 18.04 is being evaluated.
  12. For this release, use of Myriad devices connected to some specific hubs can fail. If you encounter errors, please try direct connect to PC port, or try a different hub.
  13. Layer optimization for layers that run on HW are seen in the profiler graph. Profiler graph, if using new parser, shows multiple connections to and out of depth wise convolutions and some other implicit layers. Note that the different groups of depthwise convolutions (optimized for HW) don’t show up explicitly in the profiler graph.
  14. For this release, networks with small input channels on Tensorflow may experience a performance penalty.
  15. Non-Overlapping Pooling can run as post operation on HW and as a separate operation in SW. Overlapping pooling is supported as a separate operation on both HW and SW
  16. FC with input NxNxD where N is higher than 1 are not supported natively on CNN Engines. Therefore, they run as a convolution
    which requires modification of prototxt for this release.
  17. A Caffe Scale layer only supports 1 input tensor.
  18. The --accuracy_adjust=VALUES flag should be used if accuracy for HW networks is low when the network is compiled with the
    default parser. A setting of --accuracy_adjust="ALL:256" has been found to improve the accuracy for most networks.
  19. For some networks, compiling and running a graph with 5 and 15 shaves is not supported.
  20. Average pooling in CNN Engine would compute incorrect values near the edges as the scale factor applied is constant depending
    on the size of the kernel.
  21. RefineDet must be compiled to run in hardware (with the --ma2480 flag) for this release
Assets 2

NCSDK v2.08.01

08 Oct 22:28
@nealvis nealvis
v2.08.01.02
0aaa3bd
Compare
Choose a tag to compare
NCSDK v2.08.01

============================================================

Movidius Neural Compute SDK Release Notes

V2.08.01 2018-10-04

============================================================

This release has been refactored and is now licensed under Apache 2.0 license.

As of V2.05.00, SDK has been refactored and contains many new features and structural changes. It is recommended you read the documentation to familiarize with the new features and contents.

SDK Notes:

New features:

  1. Tensorflow 1.09 supported. Tensorflow 1.09 is automatically installed on Ubuntu.
  2. The compiler has been refactored for best performance however some networks may still see slight performance degradation.

Networks:

  1. No significant changes.

Layers:

  1. No change.

API Notes:

  1. Apps written with NCAPI v1 are not compatible with this release and need to be migrated to NCAPI v2, refer to Migrating Applications from NCAPI v1 to NCAPI v2 for information about migrating apps to the new API.

Network Notes:

Support for the following networks has been tested.

Caffe

  1. GoogleNet V1
  2. SqueezeNet V1.1
  3. LeNet
  4. CaffeNet
  5. VGG (Sousmith VGG_A)
  6. Alexnet
  7. TinyYolo v1
  8. VGG 16 (Configuration D)
  9. Resnet 18
  10. Resnet 50
  11. Mobilenet v1
  12. SSD Mobilenet v1

Tensorflow r1.09

  1. inception-v1
  2. inception-v2
  3. inception-v3
  4. inception-v4
  5. Inception ResNet v2
  6. VGG 16 (Configuration D)
  7. Mobilenet_V1_1.0 variants:
    • MobileNet_v1_1.0_224
    • MobileNet_v1_1.0_192
    • MobileNet_v1_1.0_160
    • MobileNet_v1_1.0_128
    • MobileNet_v1_0.75_224
    • MobileNet_v1_0.75_192
    • MobileNet_v1_0.75_160
    • MobileNet_v1_0.75_128
    • MobileNet_v1_0.5_224
    • MobileNet_v1_0.5_192
    • MobileNet_v1_0.5_160
    • MobileNet_v1_0.5_128
    • MobileNet_v1_0.25_224
    • MobileNet_v1_0.25_192
    • MobileNet_v1_0.25_160
    • MobileNet_v1_0.25_128
  8. TinyYolo v2 via Darkflow tranformation
  9. facenet based on inception-resnet-v1

Firmware Features:

  1. Convolutions
  • The following convolution cases have been extensively tested (for stride s): 1x1s1, 3x3s1, 5x5s1, 7x7s1, 7x7s2, 7x7s4, 1x3, 3x1, 1x7, 7x1
  • Group convolution
  • Depth Convolution
  • Dilated convolution
  1. Max Pooling Radix NxM with Stride S
  2. Average Pooling: Radix NxM with Stride S, Global average pooling
  3. Local Response Normalization
  4. Relu, Relu-X, Prelu (see erratum #9)
  5. Softmax
  6. Sigmoid
  7. Tanh (see erratum #9)
  8. Deconvolution
  9. Slice
  10. Scale
  11. ElmWise unit : supported operations - sum, prod, max
  12. Fully Connected Layers (limited support -- see erratum #8)
  13. Reshape
  14. Flatten
  15. Power
  16. Crop
  17. ELU
  18. Batch Normalization
  19. L2 Normalization
  20. Input Layer

Bug Fixes:

  1. Fixed: Various profiler issues.

Errata:

  1. Python 2.7 is fully supported for making user applications, but only the helloworld_py example runs as-is in both python 2.7 and 3.5 due to dependencies on modules.
  2. Depth-wise convolution may not be supported if channel multiplier > 1.
  3. If working behind proxy, proper proxy settings must be applied for the installer to succeed.
  4. Although improved, the installer is known to take a long time on Raspberry Pi. Date/time must be correct for SDK installation to succeed on Raspberry Pi.
  5. The Docker Non-privileged mode of operation as described in the documentation has an issue with multiple NCS devices.
  6. Inception V1 obtained values are invalid for mvNCCheck.
  7. Convolution may fail to find a solution for very large inputs.
  8. Depth-wise convolution is tested for 3x3 kernels.
  9. A TanH layer’s “top” & “bottom” blobs must have different names. This is different from a ReLU layer, whose “top” & “bottom” should be named the same as its previous layer.
  10. On upgrade from previous versions of SDK, the installer will detect if openCV 3.3.0 was installed, for example from http://github.com/movidius/ncappzoo/apps/stream_ty_gn/install-opencv-from_source.sh. For this release, the installer will prompt to uninstall this specific version of openCV. This is required for ssd-caffe to run correctly. After installation is complete, openCV 3.3.0 can be re-installed and the ssd-caffe will continue to function.
  11. The MTCNN network in the app zoo is showing unexpected behavior for this release, and is being investigated. To use MTCNN, please use version 1.12.01 of SDK.
  12. Although mvNCCheck shows per-pixel error for some metrics for mobilenet_v1_224, classification results are not impacted.
  13. Only Ubuntu 16.04 LTS is supported as a host OS for this release. Ubuntu 18.04 is being evaluated.
  14. Group Deconvolution with "group" parameter != 1 is not supported on the new parser.
  15. For this release, use of Myriad devices connected to some specific hubs can fail. If you encounter errors, please try direct connect to PC port, or try a different hub.
  16. Loading multiple graphs into one Myriad device may show stability issues with this release.
Assets 2

NCSDK v1.12.01

08 Oct 22:27
@nealvis nealvis
v1.12.01.01
949131b
Compare
Choose a tag to compare
NCSDK v1.12.01

============================================================

Movidius Neural Compute SDK Release Notes

V1.12.01 2018-10-05

============================================================

SDK Notes:

New features:

  1. This release (1.12.01) is functionally identical to 1.12.00, however it has been re-factored so that everything in the public repository is now licensed via the Apache 2.0 open source license terms per the LICENSE file in the root directory. Non open source components may be downloaded during the installation.
  2. Improved compiler support for custom networks that use variable batch size via Tensorflow.
  3. Improved description on how to use Tensorflow networks that were built for training. Please see "Guidance for Compiling TensorFlow Networks" in the SDK documentation

Networks:

  1. Facenet based on inception-resnet-v1 (see erratum #12)

Layers:

API Notes:

  1. No change

Network Notes:

Support for the following networks has been tested.

Caffe

  1. GoogleNet V1
  2. SqueezeNet V1.1
  3. LeNet
  4. CaffeNet
  5. VGG (Sousmith VGG_A)
  6. Alexnet
  7. TinyYolo v1
  8. VGG 16
  9. Resnet 50
  10. Resnet-18
  11. SSD Mobilenet v1

Tensorflow r1.3

  1. inception-v1
  2. inception-v2
  3. inception-v3
  4. inception-v4
  5. Inception ResNet v2
  6. VGG 16
  7. Mobilenet_V1_1.0 variants:
    • MobileNet_v1_1.0_224
    • MobileNet_v1_1.0_192
    • MobileNet_v1_1.0_160
    • MobileNet_v1_1.0_128
    • MobileNet_v1_0.75_224
    • MobileNet_v1_0.75_192
    • MobileNet_v1_0.75_160
    • MobileNet_v1_0.75_128
    • MobileNet_v1_0.5_224
    • MobileNet_v1_0.5_192
    • MobileNet_v1_0.5_160
    • MobileNet_v1_0.5_128
    • MobileNet_v1_0.25_224
    • MobileNet_v1_0.25_192
    • MobileNet_v1_0.25_160
    • MobileNet_v1_0.25_128
  8. TinyYolo v2 via Darkflow tranformation
  9. Facenet based on inception-resnet-v1 (See erratum #12)

Firmware Features:

  1. Convolutions
  • NxN Convolution with Stride S.
  • The following cases have been extensively tested: 1x1s1,3x3s1,5x5s1,7x7s1, 7x7s2, 7x7s4
  • Group convolution
  • Depth Convolution
  • Dilated convolution
  1. Max Pooling Radix NxM with Stride S
  2. Average Pooling: Radix NxM with Stride S, Global average pooling
  3. Local Response Normalization
  4. Relu, Relu-X, Prelu (see erattum #10)
  5. Softmax
  6. Sigmoid
  7. Tanh (see erratum #10)
  8. Deconvolution
  9. Slice
  10. Scale
  11. ElmWise unit : supported operations - sum, prod, max
  12. Fully Connected Layers (limited support -- see erratum #8)
  13. Reshape
  14. Flatten
  15. Power
  16. Crop
  17. ELU
  18. Batch Normalization
  19. L2 Normalization
  20. Input Layer

Bug Fixes:

  1. Fixed: Tensorflow FusedBatchNorm doesn't support fully connected layer inputs
  2. Fixed: Mobilenets on Tensforflow 1.4 provide incorrect classification
  3. Fixed: Resnet-18 on Caffe providing NaN results

Errata:

  1. Python 2.7 is fully supported for making user applications, but only the helloworld_py example runs as-is in both python 2.7 and 3.5 due to dependencies on modules.
  2. SDK tools for tensorflow on Rasbpian Stretch are not supported for this release, due to lack of an integrated tensorflow installer for Rasbpian in the SDK. TF examples are provided with pre-compiled graph files to allow them to run on Rasperry Pi, however the compile, profile, and check functions will not be available on Raspberry Pi, and 'make examples' will generate failures for the tensorflow examples on Raspberry Pi.
  3. Depth-wise convolution may not be supported if channel multiplier > 1.
  4. If working behind proxy, proper proxy settings must be applied for the installer to succeed.
  5. Although improved, the installer is known to take a long time on Raspberry Pi. Date/time must be correct for SDK installation to succeed on Raspberry Pi.
  6. Default system virtual memory swap file size is too small to compile AlexNet on Raspberry Pi. VGG 16 not verified to compile on Pi.
  7. Raspberry Pi users will need to upgrade to Raspbian Stretch for releases after 1.09.
  8. Convolution may fail to find a solution for very large inputs.
  9. Depth convolution is tested for 3x3 kernels.
  10. A TanH layer’s “top” & “bottom” blobs must have different names.  This is different from a ReLU layer, whose “top” & “bottom” should be named the same as its previous layer.
  11. On upgrade from previous versions of SDK, the installer will detect if openCV 3.3.0 was installed, for example from http://github.com/movidius/ncappzoo/apps/stream_ty_gn/install-opencv-from_source.sh. For this release, the installer will prompt to uninstall this specific version of openCV. This is required for ssd-caffe to run correctly. After 1.11 installation is complete, openCV 3.3.0 can be re-installed and the ssd-caffe will continue to function.
  12. Facenet requires L2 Normalization be inserted to be used, please see the support forum for a saver script example.
  13. Although mvNCCheck shows per-pixel error for some metrics for mobilenet_v1_224, classification results are not impacted.
  14. Initial validation has been done on SSD Mobilenet v1 and TinyYolo v2 but more thorough evaluation is underway.
Assets 2