Skip to content

Vite, TypeScript, UniCli, Vue3. RealTime Human body posture detection in the WeChat MiniProgram, supporting PoseNet, MoveNet, BlazePose models. Support WeChat front and rear camera switching, FPS callback, frame-by-frame detection result callback

License

Notifications You must be signed in to change notification settings

spianmo/MultiPose-MiniProgram

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

36 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

MultiPose-MiniProgram

Vite, TypeScript, UniCli, Vue3。微信小程序中的人体姿势检测,支持PoseNet、MoveNet、BlazePose模型

  • 已封装组件,支持微信前后置摄像头的切换,FPS回调,逐帧检测结果回调
    <!--图层:姿势检测驱动-->
    <div class="tf-layer-pose">
      <PoseDetectionView ref="poseDetectionView" detect-model="BlazePose-Lite" camera-position="front"
                         :detect-callback="detectCallback"/>
    </div>
  • 支持的模型配置
export const DETECT_CONFIG: any = {
    "PoseNet-MobileNetV1": {
        model: SupportedModels.PoseNet,
        modelConfig: {
            architecture: 'MobileNetV1',
            outputStride: 16,
            inputResolution: {width: 640, height: 480},
            multiplier: 0.75,
            modelUrl: POSENET_URL
        }
    },
    "MoveNet-SinglePose-Lightning": {
        model: SupportedModels.MoveNet,
        modelConfig: {
            modelType: movenet.modelType.SINGLEPOSE_LIGHTNING,
            modelUrl: MOVENET_SINGLEPOSE_LIGHTNING_URL
        }
    },
    "MoveNet-SinglePose-Thunder": {
        model: SupportedModels.MoveNet,
        modelConfig: {modelType: movenet.modelType.SINGLEPOSE_THUNDER},
        modelUrl: MOVENET_SINGLEPOSE_THUNDER_URL
    },
    "BlazePose-Lite": {
        model: SupportedModels.BlazePose,
        modelConfig: {
            runtime: 'tfjs',
            modelType: 'lite',
            enableSmoothing: true,
            detectorModelUrl: DEFAULT_BLAZEPOSE_DETECTOR_MODEL_URL,
            landmarkModelUrl: DEFAULT_BLAZEPOSE_LANDMARK_MODEL_URL_LITE
        }
    },
    "BlazePose-Full": {
        model: SupportedModels.BlazePose,
        modelConfig: {
            runtime: 'tfjs',
            modelType: 'full',
            enableSmoothing: true,
            detectorModelUrl: DEFAULT_BLAZEPOSE_DETECTOR_MODEL_URL,
            landmarkModelUrl: DEFAULT_BLAZEPOSE_LANDMARK_MODEL_URL_FULL
        }
    },
    "BlazePose-Heavy": {
        model: SupportedModels.BlazePose,
        modelConfig: {
            runtime: 'tfjs',
            modelType: 'heavy',
            enableSmoothing: true,
            detectorModelUrl: DEFAULT_BLAZEPOSE_DETECTOR_MODEL_URL,
            landmarkModelUrl: DEFAULT_BLAZEPOSE_LANDMARK_MODEL_URL_HEAVY
        }
    }
}

About

Vite, TypeScript, UniCli, Vue3. RealTime Human body posture detection in the WeChat MiniProgram, supporting PoseNet, MoveNet, BlazePose models. Support WeChat front and rear camera switching, FPS callback, frame-by-frame detection result callback

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published