New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
s3select: Limit bug json #150
base: master
Are you sure you want to change the base?
Conversation
fix for json parser processing more chunks than specified in the limit Signed-off-by: Albin Antony <albinantony20@gmail.com>
71e4031
to
4eb782c
Compare
if(is_sql_limit_reached()) | ||
{ | ||
status = JSON_PROCESSING_LIMIT_REACHED;//returning number since sql_execution_on_row_cb is a callback; the caller can not access the object | ||
m_sql_processing_status = s3selectEngine::base_s3object::Status::LIMIT_REACHED; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
reviewing function
is_sql_limit_reached
https://github.com/ceph/s3select/blob/4eb782c028d210f3af7407467ec878d2a84457d4/include/s3select.h#L2223C8-L2223C28
this line is obsolete.
|
||
if(m_is_limit_on && m_row_count == m_limit) { | ||
m_sql_processing_status = s3selectEngine::base_s3object::Status::LIMIT_REACHED; | ||
} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
reviewing getMatchRow
Line 2433 in 4eb782c
Status getMatchRow( std::string& result) |
it handles the m_sql_processing_status
this issue may relate to the from-clause functionality (scan for the next row) the scanner refers to keys that match the from-clause-pattern as an object or array. it should be fixed in #129 |
fix for json parser processing more chunks than specified in the limit
https://bugzilla.redhat.com/show_bug.cgi?id=2242089