Releases · chigkim/VOCR

26 Jan 14:54

chigkim

v2.0.0-beta.2

d7b8202

VOCR v2.0.0-beta.2 Pre-release

Pre-release

Changelog

New updates submenu
Able to toggle automatically check for updates and automatically install updates from the menu.
Pre-release channel
Kill other running instances VOCR.
Store API key in Keychain
- Quit VOCR
- Delete ~/Library/Preferences/com.chikim.VOCR.plist permanently with Command+Option+Delete
- Reboot.
Added permission for notification center
Fixed when menu is not working after closing a window
Logger creates file when the file is deleted.
Check for update when launching
Increased timeout for request to 10 minutes
Play sound when VOCR is launched and ready.
Alert update through notification center
Fixed error when encountering Ollama model with no families.
Realtime OCR shortcut toggles the feature.
Autoupdater
Implemented logger
Ask which model for Ollama to use if multiple clip models are found.
You can also select a model for Ollama by just click Ollama in the model menu.
Ask for a prompt after taking a screenshot.
New prompt for explore
Explore no longer generates images meant for debugging.
Presents the same menu when launched by shortcut or clicking statusbar.
Reports more errors when request fails.
Cancels previous request when making new request
Ollama support
Use original screenshot resolution instead of window resolution point except explore mode.
New Workflow: Use Command+Control+Shift+W/V to set the target to a window/VOCursor and perform the OCR scan. After that, the features such as real-time OCR, explore, and ask will use the target.
Reset shortcut if there are different features after an update
Bug fix: global shortcuts sometimes not active
Customize shortcuts
Token usage at the end of description
Support system prompt for GPT
Setting to toggle use last prompt without asking
Save last screenshot
Dismiss menu with command+Z instead of esc if realtime or navigation is active.
You can just press return to ask GPT without editing.
Changed diff algorithm for less verbose realtime OCR.
Realtime OCR remains active at its initial location, allowing you to move the VOCursor during the process. To perform realtime OCR in a different location, stop the OCR, move the VOCursor, then restart realtime OCR.
Realtime OCR of VOCursor: Command+Control+Shift+r
Able to toggle obbject detection from the setings.
OCR Window: Command+Control+Shift+w
OCR VOCursor: Command+Control+Shift+v
Ask GPT about VOCursor: Command+Control+Shift+a
Settings: Command+Control+Shift+S
Faster screenshot of VOCursor
Open an image file in VOCR from finder to ask GPT
Gpt response gets copied to the clipboard, so you can paste somewhere if you miss it.
Object Detection through rectangles: Any boxes without text such as icons.
Moved save OCR result to the menu.
Moved target window to settings menu.
auto Scan: Thanks @vick08
Readme Improvement: Thanks @ssawczyn

The GPT features utilize GPT-4V, and they require your own OpenAI API key.

The usage cost from VOCR is an estimate. For the official usage and cost, please refer to the Usage Dashboard on OpenAI website. Also you can create an monthly limit and alert on the website as well.

Explore feature only works with GPT, and location information from the model is extremely unreliable and inaccurate.

Instruction for Ollama

Download Ollama and install.
Open terminal, and type "ollama run llava" without the quotes.
Wait until you get the prompt >>> send a message
Then type /bye and press return
Quit terminal
Go to VOCR menu > Settings > Models and select Ollama

Experimental

These features may not make into the public release.

Identify object when navigation is active: Command+Control+I
Explore window with GPT: Command+Control+Shift+e
an option to switch to using a local model such as Llava using llama.cpp instead of GPT.

Warning: It's very complex to set your own Llama.cpp server.

Download

Assets 3

21 Jan 12:31