@vladmandic/human

Version: 3.2.2
Description: Human: AI-powered 3D Face Detection & Rotation Tracking, Face Description & Recognition, Body Pose Tracking, 3D Hand & Finger Tracking, Iris Analysis, Age & Gender & Emotion Prediction, Gesture Recognition

Author: Vladimir Mandic mandic00@live.com
License: MIT
Repository: https://github.com/vladmandic/human

Changelog

HEAD -> main 2024/04/17 mandic00@live.com

fix flazeface tensor scale and update build platform

3.2.2 2024/04/17 mandic00@live.com

release: 3.2.1 2024/02/15 mandic00@live.com

3.2.1 2024/02/15 mandic00@live.com

3.2.0 2023/12/06 mandic00@live.com

set browser false when navigator object is empty
#402

release: 3.1.2 2023/09/18 mandic00@live.com

full rebuild

3.1.2 2023/09/18 mandic00@live.com

major toolkit upgrade
full rebuild
major toolkit upgrade

3.1.1 2023/08/05 mandic00@live.com

fixes plus tfjs upgrade for new release

3.0.7 2023/06/12 mandic00@live.com

full rebuild
fix memory leak in histogramequalization
initial work on tracker

3.0.6 2023/03/21 mandic00@live.com

add optional crop to multiple models
fix movenet-multipose
add electron detection
fix gender-ssrnet-imdb
add movenet-multipose workaround
rebuild and publish
add face.detector.minsize configurable setting
add affectnet

3.0.5 2023/02/02 mandic00@live.com

add gear-e models
detect react-native
redo blazeface annotations

3.0.4 2023/01/29 mandic00@live.com

make naviator calls safe
fix facedetector-only configs

3.0.3 2023/01/07 mandic00@live.com

full rebuild

3.0.2 2023/01/06 mandic00@live.com

default face.rotation disabled

release: 3.0.1 2022/11/22 mandic00@live.com

3.0.1 2022/11/22 mandic00@live.com

support dynamic loads
polish demos
add facedetect demo and fix model async load
enforce markdown linting
cleanup git history
default empty result
refactor draw and models namespaces
refactor distance
add basic anthropometry
added webcam id specification
include external typedefs
prepare external typedefs
rebuild all
include project files for types
architectural improvements
refresh dependencies
add named exports
add draw label templates
reduce dev dependencies
tensor rank strong typechecks
rebuild dependencies

2.11.1 2022/10/09 mandic00@live.com

add rvm segmentation model
add human.webcam methods
create funding.yml
fix rotation interpolation

2.10.3 2022/09/21 mandic00@live.com

add human.video method

2.10.2 2022/09/11 mandic00@live.com

add node.js esm compatibility (#292)
release

2.10.1 2022/09/07 mandic00@live.com

release candidate
add config flags
test update
release preview
optimize startup sequence
reorder backend init code
test embedding
embedding test
add browser iife tests
minor bug fixes and increased test coverage
extend release tests
add model load exception handling
add softwarekernels config option
expand type safety
full eslint rule rewrite

2.9.4 2022/08/20 mandic00@live.com

add browser test
add tensorflow library detection
fix wasm detection
enumerate additional models
release refresh

2.9.3 2022/08/10 mandic00@live.com

rehault testing framework
release refresh
add insightface

2.9.2 2022/08/08 mandic00@live.com

release rebuild

2.9.1 2022/07/25 mandic00@live.com

full rebuild
release cleanup
tflite experiments
add load monitor test
beta for upcoming major release
swtich to release version of tfjs
placeholder for face contours
improve face compare in main demo
add webview support
fix(gear): ensure gear.modelpath is used for loadmodel()
npm default install should be prod only
fix npm v7 compatibility
add getmodelstats method
rebuild
release build

2.8.1 2022/06/08 mandic00@live.com

webgpu and wasm optimizations
add faceboxes prototype
full rebuild

2.7.4 2022/05/24 mandic00@live.com

2.7.3 2022/05/24 mandic00@live.com

add face.mesh.keepinvalid config flag
initial work for new facemesh model

2.7.2 2022/05/12 mandic00@live.com

fix demo when used with video files
major release

2.7.1 2022/05/09 mandic00@live.com

support 4k input
add attention draw methods
fix coloring function
enable precompile as part of warmup
prepare release beta
change default face crop
beta release 2.7
refactor draw methods
implement face attention model
add electronjs demo
rebuild

2.6.5 2022/04/01 mandic00@live.com

bundle offscreencanvas types
prototype precompile pass
fix changelog generation
fix indexdb config check

2.6.4 2022/02/27 mandic00@live.com

fix types typo
refresh
add config option wasmplatformfetch

2.6.3 2022/02/10 mandic00@live.com

rebuild

2.6.2 2022/02/07 mandic00@live.com

release rebuild

2.6.1 2022/01/20 mandic00@live.com

implement model caching using indexdb
prototype global fetch handler
fix face box and hand tracking when in front of face

2.5.8 2022/01/14 mandic00@live.com

fix samples
fix(src): typo
change on how face box is calculated

2.5.7 2021/12/27 mandic00@live.com

fix posenet
release refresh

2.5.6 2021/12/15 mandic00@live.com

strong type for string enums
rebuild
fix node detection in electron environment

2.5.5 2021/12/01 mandic00@live.com

added human-motion
add offscreencanvas typedefs
release preview
fix face box scaling on detection
cleanup

2.5.4 2021/11/22 mandic00@live.com

prototype blazepose detector
minor fixes
add body 3d interpolation
edit blazepose keypoints
new build process

2.5.3 2021/11/18 mandic00@live.com

create typedef rollup
optimize centernet
cache frequent tf constants
add extra face rotation prior to mesh
release 2.5.2
improve error handling

2.5.2 2021/11/14 mandic00@live.com

fix mobilefacenet module
fix gear and ssrnet modules
fix for face crop when mesh is disabled
implement optional face masking
add similarity score range normalization
add faceid demo
documentation overhaul
auto tensor shape and channels handling
disable use of path2d in node
add liveness module and facerecognition demo
initial version of facerecognition demo
rebuild
add type defs when working with relative path imports
disable humangl backend if webgl 1.0 is detected
add additional hand gestures

2.5.1 2021/11/08 mandic00@live.com

new human.compare api
added links to release notes
new frame change detection algorithm
add histogram equalization
implement wasm missing ops
performance and memory optimizations
fix react compatibility issues
improve box rescaling for all modules
improve precision using wasm backend
refactor predict with execute
patch tfjs type defs
start 2.5 major version
build and docs cleanup
fix firefox bug

2.4.3 2021/10/28 mandic00@live.com

additional human.performance counters

2.4.2 2021/10/27 mandic00@live.com

add ts demo
switch from es2018 to es2020 for main build
switch to custom tfjs for demos
release 2.4

2.4.1 2021/10/25 mandic00@live.com

refactoring plus jsdoc comments
increase face similarity match resolution
time based caching
turn on minification
initial work on skiptime
added generic types
enhanced typing exports
add optional autodetected custom wasm path

2.3.6 2021/10/21 mandic00@live.com

fix for human.draw labels and typedefs
refactor human.env to a class type
add human.custom.esm using custom tfjs build

2.3.5 2021/10/19 mandic00@live.com

removed direct usage of performance.now

2.3.4 2021/10/19 mandic00@live.com

minor blazepose optimizations
compress samples
remove posenet from default package
enhanced movenet postprocessing
use transferrable buffer for worker messages
add optional anti-spoofing module
add node-match advanced example using worker thread pool
package updates
optimize image preprocessing
set webgpu optimized flags
major precision improvements to movenet and handtrack
image processing fixes
redesign body and hand caching and interpolation
demo default config cleanup
improve gaze and face angle visualizations in draw
release 2.3.1

2.3.1 2021/10/06 mandic00@live.com

workaround for chrome offscreencanvas bug
fix backend conflict in webworker
add blazepose v2 and add annotations to body results
fix backend order initialization
added docker notes
breaking change: new similarity and match methods
tweaked default values
enable handtrack as default model
redesign face processing
refactoring
define app specific types
implement box caching for movenet
autodetect number of bodies and hands
upload new samples
new samples gallery and major code folder restructure
new release

2.2.3 2021/09/24 mandic00@live.com

optimize model loading
support segmentation for nodejs
redo segmentation and handtracking
prototype handtracking
automated browser tests
support for dynamic backend switching
initial automated browser tests
enhanced automated test coverage
more automated tests
added configuration validation
prevent validation failed on some model combinations
webgl exception handling

2.2.2 2021/09/17 mandic00@live.com

experimental webgl status monitoring
major release

2.2.1 2021/09/16 mandic00@live.com

add vr model demo
all tests passing
redefine draw helpers interface
add simple webcam and webrtc demo
added visual results browser to demo
reorganize tfjs bundle
experimental custom tfjs bundle - disabled
add platform and backend capabilities detection
enhanced automated tests
enable canvas patching for nodejs
full ts strict typechecks
fix multiple memory leaks
modularize human class and add model validation
add dynamic kernel op detection
added human.env diagnostic class
minor typos
release candidate
parametrize face config
mark all config items as optional
redefine config and result interfaces
fix usge of string enums
start using partial definitions
implement event emitters
fix iife loader
simplify dependencies
change build process
add benchmark info
simplify canvas handling in nodejs
full rebuild

2.1.5 2021/08/31 mandic00@live.com

added demo node-canvas
dynamically generate default wasm path
implement finger poses in hand detection and gestures
implemented movenet-multipose model

2.1.4 2021/08/19 mandic00@live.com

add static type definitions to main class
fix interpolation overflow
rebuild full
improve face box caching
strict type checks
add webgu checks
experimental webgpu support
add experimental webgu demo
add backend initialization checks
complete async work
list detect cameras
switch to async data reads

2.1.3 2021/08/12 mandic00@live.com

fix centernet & update blazeface
minor update
replace movenet with lightning-v4
enable webgl uniform support for faster warmup

2.1.2 2021/07/29 mandic00@live.com

fix unregistered ops in tfjs
fix typo
rebuild new release

2.1.1 2021/07/29 mandic00@live.com

add note on manually disping tensor
modularize model loading

2.0.3 2021/06/18 mandic00@live.com

fix demo paths
added multithreaded demo

2.0.2 2021/06/14 mandic00@live.com

reorganize demos
fix centernet box width & height
add body segmentation sample
add release notes
release 2.0

2.0.1 2021/06/08 mandic00@live.com

add video drag&drop capability
modularize build platform
custom build tfjs from sources
modularize build platform
enable body segmentation and background replacement in demo
minor git corruption
unified build
enable body segmentation and background replacement
work on body segmentation
added experimental body segmentation module
add meet and selfie models
add live hints to demo
switch worker from module to iife importscripts
release candidate
added samples to git
implemented drag & drop for image processing
release candidate
breaking changes to results.face output properties
breaking changes to results.object output properties
breaking changes to results.hand output properties
breaking changes to results.body output properties
implemented human.next global interpolation method
finished draw buffering and smoothing and enabled by default
implemented service worker
release candidate
added usage restrictions
quantize handdetect model
added experimental movenet-lightning and removed blazepose from default dist
added experimental face.rotation.gaze
fix and optimize for mobile platform
lock typescript to 4.2 due to typedoc incompatibility with 4.3

1.9.4 2021/05/27 mandic00@live.com

fix demo facecompare
webhint and lighthouse optimizations
add camera startup diag messages
implemented unified result.persons that combines face, body and hands for each person
added experimental results interpolation for smooth draw operations

1.9.3 2021/05/23 mandic00@live.com

use green weighted for input diff calculation
implement experimental drawoptions.bufferedoutput and bufferedfactor
use explicit tensor interface
add tfjs types and remove all instances of any
enhance strong typing
rebuild all for release

1.9.2 2021/05/22 mandic00@live.com

add id and boxraw on missing objects
restructure results strong typing

1.9.1 2021/05/21 mandic00@live.com

caching improvements
add experimental mb3-centernet object detection
individual model skipframes values still max high threshold for caching
config.videooptimized has been removed and config.cachesensitivity has been added instead
caching determination is now dynamic based on detection of input change and not based on input types
human 1.9.0 beta with breaking changes regarding caching

1.8.5 2021/05/18 mandic00@live.com

add node-video sample
add node-webcam demo
fix node build and update model signatures

1.8.4 2021/05/11 mandic00@live.com

1.8.3 2021/05/05 mandic00@live.com

switch posenet weights

1.8.2 2021/05/04 mandic00@live.com

release 1.8 with major changes and tfjs 3.6.0

1.8.1 2021/04/30 mandic00@live.com

blazeface optimizations
add hand labels in draw
cleanup demo workflow
convert blazeface to module
version 1.8 release candidate
build nodejs deliverables in non-minified form
stop building sourcemaps for nodejs deliverables
remove deallocate, profile, scoped
replaced maxfaces, maxdetections, maxhands, maxresults with maxdetected
replaced nmsradius with built-in default
unified minconfidence and scorethresdold as minconfidence
add exception handlers to all demos
remove blazeface-front and add unhandledrejection handler
major update for 1.8 release candidate
enable webworker detection

1.7.1 2021/04/25 mandic00@live.com

remove obsolete binary models
enable cross origin isolation
rewrite posenet decoder
remove efficientpose
major version rebuild

1.6.1 2021/04/22 mandic00@live.com

add npmrc
added filter.flip feature
added demo load image from http
mobile demo optimization and iris gestures
full rebuild
new look
added benchmarks
added node-multiprocess demo
fix image orientation
flat app style
add full nodejs test coverage

1.5.2 2021/04/14 mandic00@live.com

experimental node-wasm support

1.5.1 2021/04/13 mandic00@live.com

fix for safari imagebitmap
refactored human.config and human.draw

1.4.3 2021/04/12 mandic00@live.com

implement webrtc

1.4.2 2021/04/12 mandic00@live.com

added support for multiple instances of human
fix typedoc
exception handling

1.4.1 2021/04/09 mandic00@live.com

add modelbasepath option

1.3.5 2021/04/06 mandic00@live.com

add dynamic viewport and fix web worker
add cdn links

1.3.4 2021/04/04 mandic00@live.com

implement webhint

1.3.3 2021/04/03 mandic00@live.com

fix linting and tests

1.3.2 2021/04/02 mandic00@live.com

input type validation
normalize all scores

1.3.1 2021/03/30 mandic00@live.com

added face3d demo
initial work on face3d three.js demo
enable buffering
new icons
new serve module and demo structure
move gl flags to correct location
minor rotation calculation fix
remove debug output
new face rotation calculations
cleanup
rotationmatrixtoeulerangle, and fixes
experimental: add efficientpose
implement nanodet
face rotation matrix
start working on efficientpose

1.2.5 2021/03/25 mandic00@live.com

fix broken exports
added face matching example to docs
improve fact matching

1.2.4 2021/03/23 mandic00@live.com

1.2.3 2021/03/21 mandic00@live.com

1.2.2 2021/03/21 mandic00@live.com

precise face rotation

1.2.1 2021/03/21 mandic00@live.com

new module: face description

1.1.11 2021/03/21 mandic00@live.com

refactor face classes

1.1.10 2021/03/18 mandic00@live.com

cleanup
redefine tensor
enforce types
regen type declarations
switch to single jumbo dts
type definitions

1.1.9 2021/03/17 mandic00@live.com

fix box clamping and raw output
hierarchical readme notes

1.1.8 2021/03/17 mandic00@live.com

add experimental nanodet object detection
full models signature

1.1.7 2021/03/16 mandic00@live.com

fix for seedrandom
custom typedoc

1.1.6 2021/03/15 mandic00@live.com

implement human.match and embedding demo

1.1.5 2021/03/15 mandic00@live.com

full rebuild

1.1.4 2021/03/14 mandic00@live.com

fix broken build

1.1.3 2021/03/14 mandic00@live.com

added api specs
add typedocs and types
strong typings

1.1.2 2021/03/12 mandic00@live.com

distance based on minkowski space and limited euclidean space
guard against invalid input images

1.1.1 2021/03/12 mandic00@live.com

switched face embedding to mobileface

1.0.4 2021/03/11 mandic00@live.com

add face return tensor
add test for face descriptors
wip on embedding
simplify face box coordinate calculations
annotated models and removed gender-ssrnet
autodetect inputsizes

1.0.3 2021/03/10 mandic00@live.com

strong typing for public classes and hide private classes
enhanced age, gender, emotion detection
full rebuild

1.0.2 2021/03/09 mandic00@live.com

remove blazeface-front, blazepose-upper, faceboxes
remove blazeface-front and faceboxes

1.0.1 2021/03/09 mandic00@live.com

fix for face detector when mesh is disabled
optimize for npm
0.40.9
fix performance issue when running with low confidence
0.40.8
0.40.7
implemented 3d face angle calculations
0.40.6
add curve draw output
0.40.5
fix human.draw
0.40.4
fix demo
0.40.3
0.40.2
added blazepose-upper
0.40.1
implement blazepose and update demos
add todo list
0.30.6
fine tuning age and face models
0.30.5
add debug logging flag
0.30.4
added skipinitial flag
0.30.3
typo
0.30.2
rebuild
fix typo
0.30.1
0.20.11
0.20.10
0.20.9
0.20.8
0.20.7
build fix
0.20.6
embedding fix
0.20.5
fix imagefx and add dev builds
0.20.4
0.20.3
rebuild
0.20.2
merge branch 'main' of https://github.com/vladmandic/human into main
create codeql-analysis.yml
create security.md
add templates
0.20.1
menu fixes
convert to typescript
0.11.5
added faceboxes alternative model
0.11.4
0.11.3
0.11.2
added warmup for nodejs
0.11.1
0.10.2
0.10.1

0.9.26 2021/01/18 mandic00@live.com

fix face detection when mesh is disabled
version bump

0.9.25 2021/01/13 mandic00@live.com

added humangl custom backend
rebuild
code cleanup and enable minification
fix safari incopatibility

0.9.24 2021/01/12 mandic00@live.com

work on blazepose
full rebuild

0.9.23 2021/01/11 mandic00@live.com

added iris gesture
fix emotion labels
full rebuild

0.9.22 2021/01/05 mandic00@live.com

remove iris coords if iris is disabled
web worker fix

0.9.21 2021/01/03 mandic00@live.com

0.9.20 2021/01/03 mandic00@live.com

stricter linting, fix face annotations

0.9.19 2020/12/23 mandic00@live.com

added rawbox and rawmesh
variable name changes, setting .rawcoords only if necessary
option to return raw data (mesh, box) for facemesh / "preserve aspect ratio" fix from facemesh upstream