Instructions to use FINAL-Bench/Darwin-180B-RSI-R3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use FINAL-Bench/Darwin-180B-RSI-R3 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="FINAL-Bench/Darwin-180B-RSI-R3")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("FINAL-Bench/Darwin-180B-RSI-R3")
model = AutoModelForMultimodalLM.from_pretrained("FINAL-Bench/Darwin-180B-RSI-R3", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use FINAL-Bench/Darwin-180B-RSI-R3 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "FINAL-Bench/Darwin-180B-RSI-R3"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "FINAL-Bench/Darwin-180B-RSI-R3",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/FINAL-Bench/Darwin-180B-RSI-R3

SGLang

How to use FINAL-Bench/Darwin-180B-RSI-R3 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "FINAL-Bench/Darwin-180B-RSI-R3" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "FINAL-Bench/Darwin-180B-RSI-R3",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "FINAL-Bench/Darwin-180B-RSI-R3" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "FINAL-Bench/Darwin-180B-RSI-R3",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use FINAL-Bench/Darwin-180B-RSI-R3 with Docker Model Runner:
```
docker model run hf.co/FINAL-Bench/Darwin-180B-RSI-R3
```

SeaWolf-AI commited on 7 days ago

Commit

25d3fde

verified ·

1 Parent(s): 8cc244b

Add files using upload-large-folder tool

Browse files

Files changed (38) hide show

model-00002-of-00131.safetensors +3 -0
model-00014-of-00131.safetensors +3 -0
model-00015-of-00131.safetensors +3 -0
model-00022-of-00131.safetensors +3 -0
model-00027-of-00131.safetensors +3 -0
model-00028-of-00131.safetensors +3 -0
model-00029-of-00131.safetensors +3 -0
model-00031-of-00131.safetensors +3 -0
model-00035-of-00131.safetensors +3 -0
model-00040-of-00131.safetensors +3 -0
model-00043-of-00131.safetensors +3 -0
model-00048-of-00131.safetensors +3 -0
model-00066-of-00131.safetensors +3 -0
model-00069-of-00131.safetensors +3 -0
model-00074-of-00131.safetensors +3 -0
model-00076-of-00131.safetensors +3 -0
model-00077-of-00131.safetensors +3 -0
model-00079-of-00131.safetensors +3 -0
model-00081-of-00131.safetensors +3 -0
model-00082-of-00131.safetensors +3 -0
model-00084-of-00131.safetensors +3 -0
model-00086-of-00131.safetensors +3 -0
model-00087-of-00131.safetensors +3 -0
model-00089-of-00131.safetensors +3 -0
model-00092-of-00131.safetensors +3 -0
model-00095-of-00131.safetensors +3 -0
model-00096-of-00131.safetensors +3 -0
model-00100-of-00131.safetensors +3 -0
model-00107-of-00131.safetensors +3 -0
model-00109-of-00131.safetensors +3 -0
model-00111-of-00131.safetensors +3 -0
model-00112-of-00131.safetensors +3 -0
model-00117-of-00131.safetensors +3 -0
model-00120-of-00131.safetensors +3 -0
model-00124-of-00131.safetensors +3 -0
model-00127-of-00131.safetensors +3 -0
model-00130-of-00131.safetensors +3 -0
model-00131-of-00131.safetensors +3 -0

model-00002-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1da92de7cf72dcca86faf05007925389ceb24427609e8d3b478d53d97fd97a63
+size 3355443368

model-00014-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5ee73bd21c73b2610d2a30924f7acd24e63b1ca29e0a1f1c87f0f6a9648e347a
+size 3200016032

model-00015-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b35421bf21724db705a38ee9f779de07f9f1711be964049942960c5e3dddb1c2
+size 3200016032

model-00022-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:7d205070bb898c59d23bc379652607911f39e219627028a29d82e8e8fecab7c0
+size 3200016032

model-00027-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4981d4e636723dbb063f04854e4362c1fe341d9ba80b5bb4231bb0d5ee8ab266
+size 3200016032

model-00028-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1b45a957b1f3572d325b0795f549fb772c160bd5c5167f94a347b96e3c7b978d
+size 3200016032

model-00029-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:40d2f2291ff4800373087cd00f1f95c3bd69331c32f39cfdd5d43516764b03ec
+size 3200016032

model-00031-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9b6bf01d60f21bed295b9b1d43501593b4ce7ece28aaf75618b4fb58039c0d04
+size 3200016040

model-00035-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4fe611218d36ff7c06e4c24f7252215fdddc879ac3de2b1d569727ed31f82db1
+size 3200016040

model-00040-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ed06bdece1c74ba1a87208ecc19dad59efafddc6d673a3d1ef6d25d3caf02453
+size 3355443376

model-00043-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:20821387c848de9a7ef22dfa35fea1d37e1c0825b789ea1dd82a64e1181a2a08
+size 1839072016

model-00048-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:dbbf3a6e2b81c8cf9eb152c03e07550741b6e143121fbe579e3b32cdf8836a33
+size 3355443376

model-00066-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d01dc932650fc6db9dc2f0dee7ceff6d50e286e47c4323cc30f8a527af9451fa
+size 1719221392

model-00069-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f7d460aa332a745c2da1241ad665d2a640fd87112692929df17067b3db833036
+size 3355443376

model-00074-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8d046573d942cf9e5d1bf891bd6993d75c0aada2f90f99aec92a23a028a965c5
+size 1716599840

model-00076-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6f2b7d54beca17749d19147976a3310eaf35cfbcac5c470ef4800ce024b4d853
+size 1938689480

model-00077-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a75bf91dc472eab2bd4aa907ec5216452c08b3ab915d57377ffd2acc5b1ce42c
+size 3355443376

model-00079-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e4cd07a126514c6cb325553c77b2786ba59f284b3144f89a7e34de64b42be21f
+size 3355443376

model-00081-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4cf05b67fcb861b3f55ba8d9824b12f4dcef1527d7e62c3c89b3382c95dd3634
+size 3355443368

model-00082-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:578983983b4467d759e5c8e785bf5d3340d01f15d3f52a8fc6236bc1c402a787
+size 1935433136

model-00084-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:d4e5f771b843428235721c4efb0312e372cacfb0f739728a7eb1d5ee6a51ce86
+size 1716599840

model-00086-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ab180310fb29eb446eeff03c21e4c4ba705837c3ef5c0a9463b48b392a5b1b35
+size 1941966296

model-00087-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9b9b8704d856120229e9eb147d2dcf8e9640880ded5c95856e232c8deb9a41e9
+size 3355443376

model-00089-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:640ea88172a3bfa9217e40823c1cb5a1c8b6d25a67c5ca7035013ea704d7d434
+size 3355443376

model-00092-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:60b8f85f68e4cbeafcd05b3090c5cc74940e30aa92e11ca087c8f0e459dd478d
+size 1716599840

model-00095-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:9e680b695a5bf4cb82e0a9396b77702bb785fc2ae100fbf4acfa14709e507a6e
+size 3355443376

model-00096-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b685c185e917474279cda26e3b3935e189fdf723c2f87ec72c5e5ca3b3e6f3a4
+size 1832518280

model-00100-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3e3e1119c98a94997e064455fc5d82c921dffdb21bf9b6654cd08ab3bc337a2d
+size 1716600224

model-00107-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:08fb87b54a96a6840a0ba7c7b06636caef6eef0df88d917277fef1d2ce2c3565
+size 3355443376

model-00109-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:67252c3ea4da6d0e9e68662c9b179eaf4bfab452c2d2b2c004a0a57346d0c81b
+size 3355443376

model-00111-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fe316b2426ea13ba1076c36d8f59b2391b97a5ded3fd6add382677d22637abfd
+size 3355443376

model-00112-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a4b3a555fb7eda8e27533ce9f570b5bf6d7393ef34823227927d94c0398a8219
+size 1935413176

model-00117-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:27b091d8a571ee1fc28c4c7091ff1ee969f02d772dc57f6b3a2289048b7954a7
+size 3355443376

model-00120-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5e86a22e3c549ba4f2b22f8e552acdaa9934b803ea3167c749df04a8f75fb123
+size 1948519840

model-00124-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:45e483da6b995f7243fb06206540ccd8678286197abe7ad66d491c86546f15e0
+size 1729707128

model-00127-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:fa0c609906b194b1c5172d7346f971b2ebd41f674af8f1469c2fc9232ccc2506
+size 3355443368

model-00130-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3c458b803325949b6251c63a187c7bf44f1427eb566ea3a35d5008cda0575d87
+size 2974788136

model-00131-of-00131.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:50be0ccd11e4da0c92114600aca321d2c18f795e9e923fd587469587ecfd9df4
+size 1271398528