float vector 精度问题 #32737
Unanswered
Ice-YcY
asked this question in
Q&A and General discussion
float vector 精度问题
#32737
Replies: 5 comments 9 replies
-
float小数点后不会有19位,一半只有6-7位数字 |
Beta Was this translation helpful? Give feedback.
2 replies
-
这是因为Attu使用的是node sdk。 javascript里,浮点型的数值是用64位表示的,虽然milvus返回的数据是float32,但attu显示出来就成了64位的显示。实际上小数点6,7位之后的数字你都可以忽略掉。 |
Beta Was this translation helpful? Give feedback.
7 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
2.3.x版本只支持floatvector
java sdk校验必须是float类型
但是存进vdb后发现是小数点后有19位
实际计算的逻辑是什么?
Beta Was this translation helpful? Give feedback.
All reactions