Update API: update by query

[monken]

#1583 allows to update individual documents. Update by query will reduce the network roundtrips radically if you want to update a number of documents and push work from the client to ES.

curl -XPOST localhost:9200/index/type/_update -d '{
    "query" : { "constant_score" : { "filter" : { "term" : { "counter" : 0 } } } },
    "script" : "ctx._source.counter += count",
    "params" : {
        "count" : 4
    }
}'

[Mpdreamz]

Would really love this feature too!

[r10r]

+1

[darklow]

+1

[mrgautamsam]

+1

[feridgurbuz]

+1

[gc20]

+1

[serpent403]

+1

[devilankur18]

+1

[willtrking]

+1

[ignatiusreza]

+1

[kenshin54]

+1

[noodlehaus]

+1

[Aoseala]

+1

[timotta]

I really need this feature

[burzum]

👍

[ofavre]

While waiting this feature to be officially finished and released, I've packaged the pull request #2231 as a plugin: yakaz/elasticsearch-action-updatebyquery.
Have fun.

[bobbyrenwick]

+1

[geoffwatts]

+1

[AnSavvides]

+1

[neogenix]

+1

[scriby]

+1

[gnurag]

+1

[damienalexandre]

+1

[mobalytics]

+1

[marioeu]

+1

[ogorun]

+1

[ron521]

+1

[Praveen82]

can some one review this and give feedback.
https://discuss.elastic.co/t/updatebyqueryresponse-throwing-timeout/29176

Update by query fails while update more then 20 + million record .

[rayward]

@Praveen82 you are using a 3rd party plugin. This isn't the right place to be requesting support, you should post that as an issue on that plugin's repository.

[nik9000]

#15125 is implementing a syntax that will look a little like

curl -XPOST localhost:9200/index/type/_update_by_query -d '{
    "query" : { "term" : { "counter" : 0 } },
    "script" : {
      "inline": "ctx._source.counter += count",
      "params" : {
          "count" : 4
      }
  }
}'

The reason this was stalled for so long is because of those timeouts: up until now there has been a way to launch long running job in Elasticsearch and report on their status and things. With the task management api (#15347) eminent I picked up the torch on "reindex" and "update-by-query" style things and started them again with the intent to integrate with task management ASAP.

Anyway, #15125 and any followup PRs are the place to look for this feature.

[gepuskas]

+1

[YuriMarinkov]

+1

[canyildiz]

+1

[Digital2Slave]

+1

[yossicahen]

+1

[nik9000]

Update by query is live in 2.3.0 and 5.0.0-alpha-1. The docs are here.

[scohenenator]

Does update by query in 2.3.+ or 5.+ support the javascript plugin?

[nik9000]

Does update by query in 2.3.+ or 5.+ support the javascript plugin?

If you really want it, sure. In 2.3+ we test update-by-query against groovy and in 5.+ we test against painless. We used to test against groovy and it worked there as well. I expect javascript will work fine.

[scohenenator]

JS support would be pretty slick.

[nik9000]

JS support would be pretty slick.

As I said, it exists, you just have to install the plugin.

The trouble with all of these languages is that their implementation on the JVM aren't properly oriented for embedding. That is why we don't include it by default.

Anyway, if you want to talk more about it I think discuss.elastic.co is a more appropriate place for it.