GGUF Available in NexaSDK (only). Here's how to run it locally.

#81
by alanzhuly - opened

GGUF Available in NexaSDK (only). Here's how to run it locally:

Model Card: https://huggingface.co/NexaAI/DeepSeek-OCR-GGUF

Quickstart

  1. Install NexaSDK

  2. Run the model locally with one line of code:

    nexa infer NexaAI/DeepSeek-OCR-GGUF
    
  3. Then drag your image to terminal or type into the image path

case 1 : extract text

<your-image-path> Free OCR.

case 2 : extract bounding box

<your-image-path> <|grounding|>Convert the document to markdown. 

Note: If the model fails to run, install the latest Vulkan driver for Windows

Sign up or log in to comment