Create keyboard shortcuts for auto labeling

[KC-Zhang]

after selecting the model zip in the UI and click upload, nothing happens. The auto annotate button also doesn't appear.

[bourdakos1]

Can you confirm whether or not the model made it into your object storage bucket?

[KC-Zhang]

Hey Bourdakos1, thanks for replying. It doesn't make it into the bucket. After click upload, the page stuck at "saving ....".

I also tried manually upload both the zipped and unzipped model to the bucket, but the auto annotate button still doesn't appear. I put them in the root folder in the bucket along with all the images, am I doing it wrong?

[bourdakos1]

Cloud Annotations looks for the model using this regex:

const MODEL_REGEX = /\/model\.json$/i

Can you try uploading the model files inside of a folder, but unzipped?

[KC-Zhang]

Nice!! it doesn't allow folder upload. But I was able to get it working by adding a prefex xxx/ to the unzipped files since the regex is looking for the ‘/’ character. Thank you so much for the tip!

[KC-Zhang]

This is a game changer, I just tested it. I trained the model with 20ish image and use it to autolabel similar images, and it work so well. Keep up the good work man! Also is there a keyboard shortcut for the Accept all labels/Accept label?

[bourdakos1]

awesome! umm I don't think if I have a keyboard shortcut for that, but that would be a good add. Any suggestions for keys?

[KC-Zhang]

Since the workflow is like often like this: accept all -> next image -> accept -> mouse drag -> next image -> ....
Having the accept shortcut near the 'next image' shortcut key (which is space/right arrow) is ideal.
Since right hand is using mouse, I would use space for next image.
Therefore any letter key near 'space' is a good option for accept. You could 'a' for accept and 's' for accept all. Or 'f' for accept and 'g' for accept all, the latter is slightly easier to press with thumb and index finger than the former.

[bourdakos1]

oh actually I should have shortcuts for changing the active label too, maybe Down for next Up for previous (and if you exhaust all the labels it will just keep cycling through them) then A for accept All and S for accept Single?

[bourdakos1]

if you're interested in making a contribution you could make a pull request adding the code here: https://github.com/cloud-annotations/iris/blob/master/src/client/src/App/Localization/AutoLabelPanel.js

otherwise I'm happy to make the change myself

[KC-Zhang]

oh actually I should have shortcuts for changing the active label too, maybe Down for next Up for previous (and if you exhaust all the labels it will just keep cycling through them) then A for accept All and S for accept Single?

Having up and down for changing the active label is a very good idea! That will shortcut the entire workflow. A for accept All labels and S for a accept Single label is also a great idea and the letter makes sense.

I am currently busy with some project so I can't promise to do a pull request. But as it goes, I will definitely be happy to contribute when my schedule loosen up a bit.

[bourdakos1]

@KC-Zhang there is no shortcut for deleting an image, but you should be able to delete an image by selecting Image > Delete in the top bar. You can also command click on images to select multiple

[Javokhir169]

Nice!! it doesn't allow folder upload. But I was able to get it working by adding a prefex xxx/ to the unzipped files since the regex is looking for the ‘/’ character. Thank you so much for the tip!

Can share an image of files with a changed prefix? I can't add the "/" prefix