#llama

Run large language models at home, BitTorrent‑style Generate text with Llama 3.1 (up to 405B), Mixtral (8x22B), Falcon (40B+) or BLOOM (176B) and fine‑tune them for your tasks — us

15s

GitHub - marcelroed/gigatoken: Language model tokenization at GB/s

🖼️

0

GitHub - marcelroed/gigatoken: Language model tokenization at GB/s

Hacker News·about 2 months ago

#LrKukuZn

#github #gigatoken #llama #tokenizers #tokenizer #qwen

Language model tokenization at GB/s. Contribute to marcelroed/gigatoken development by creating an account on GitHub.

15s

How to Setup a Local Coding Agent on macOS

🖼️

475

How to Setup a Local Coding Agent on macOS

Hacker News·3 months ago

#dEOSDGqk

#ikyle #gguf #gemma #llama #models #model

Running Gemma 4 26B-A4B and Qwen3.6 35B-A3B locally with llama.cpp, MTP speculative decoding, multimodal support, and PI as a coding agent.

15s

How to Deploy Llama 3.2 with TensorRT-LLM + Quantization on a $14/Month DigitalOcean GPU Droplet: 3x Faster Inference at 1/95th Claude Cost

🖼️

0

How to Deploy Llama 3.2 with TensorRT-LLM + Quantization on a $14/Month DigitalOcean GPU Droplet: 3x Faster Inference at 1/95th Claude Cost

DEV Community: webdev·RamosAI·4 months ago

#5zhYpj9b

#dev #llama #fullscreen #tensorrt #import #article

⚡ Deploy this in under 10 minutes Get $200 free: https://m.do.co/c/9fa609b86a0e ($5/month...

15s

I replaced cloud LLMs with local models running off a Proxmox LXC, and the performance trade-off was worth it

🖼️

0

I replaced cloud LLMs with local models running off a Proxmox LXC, and the performance trade-off was worth it

XDA ·Ayush Pande·4 months ago

#yknCPE4P

#xda-developers #models #llama #server #llms #nvidia

View the full article

Create a free account to read full articles inline — no redirect to the original site.

Create account Log in

I'm 15, Built My First Real Project in 4 Days, and Put It on Gumroad

🖼️

0

I'm 15, Built My First Real Project in 4 Days, and Put It on Gumroad

DEV Community·Hiroto Yoshida·4 months ago

#luTb9cJn

#dev #energy #groq #real #next #llama

I'm 15 and Built an AI Energy Dashboard with Next.js 15 + Groq Hey Dev.to! 👋 I'm a...

15s

Llama Lounge 25 at Stanford, standing room only - Jeremiah Owyang

🖼️

0

Llama Lounge 25 at Stanford, standing room only - Jeremiah Owyang

Web Strategy by Jeremiah·jeremiah_owyang·4 months ago

#lVgX5jlw

#web-strategist #breakthrough #llama #lounge #hosted #event

Sold out and standing room only. This was Llama Lounge 25 (see Luma Cal), hosted at Stanford for the second year in a row. This was Llama Lounge 25, hosted at Stanford for the second year in a row.…

15s

Llama 4 is now available on Vercel Marketplace - Vercel

📰

0

Llama 4 is now available on Vercel Marketplace - Vercel

Vercel News·Walter Korman·4 months ago

#M4KcFUvq

#vercel #groq #llama #import #article #englishlanguage

Llama 4 is now available on Vercel Marketplace via Groq to bring bring state-of-the-art AI capabilities like multimodal input to your Vercel projects.

15s

How We Built Europe’s Trusted AI Resource for 2026 (And Why It Matters)

🖼️

0

How We Built Europe’s Trusted AI Resource for 2026 (And Why It Matters)

DEV Community·Alexandru Daniel Dimitrescu·4 months ago

#7m3X4Fae

#ai #startup #emailmarketing #webdev #open #models

When we launched SmartMails in 2024, we didn’t predict everything that would happen next. But we did...

15s

Ship Your SaaS for Free: OpenRouter’s Hidden Superpower

🖼️

0

Ship Your SaaS for Free: OpenRouter’s Hidden Superpower

DEV Community·Gem Edits·4 months ago

#YeBVfjh4

#ai #productivity #javascript #software #models #openrouter

Building a SaaS typically means burning cash on API calls before you see a dollar. Not anymore....

15s

I ran this bulky LLM on an SBC cluster, and it's the most unhinged setup I've ever built

🖼️

0

I ran this bulky LLM on an SBC cluster, and it's the most unhinged setup I've ever built

XDA·Ayush Pande·4 months ago

#B1MpsHce

#sensa #community #llama #cluster #server #raspberry

From XDA Developers: I ran this bulky LLM on an SBC cluster, and it's the most unhinged setup I've ever built

15s

LLaMA.cpp Gets Qwen MTP Boost, Ring-2.6-1T for Ollama, AMD GPU Fixes

🖼️

0

LLaMA.cpp Gets Qwen MTP Boost, Ring-2.6-1T for Ollama, AMD GPU Fixes

DEV Community·soy·4 months ago

#euFhVanE

#ai #llm #selfhosted #software #ollama #model

From Dev.to - ai: LLaMA.cpp Gets Qwen MTP Boost, Ring-2.6-1T for Ollama, AMD GPU Fixes

15s

🚀 Meta Just Killed Open Source Llama: Welcome to the 'Muse Spark' Era (And What It Means for Developers)

🖼️

0

🚀 Meta Just Killed Open Source Llama: Welcome to the 'Muse Spark' Era (And What It Means for Developers)

DEV Community·Siddhesh Surve·4 months ago

#K7QSLriS

#ai #webdev #typescript #meta #muse #spark

From Dev.to - typescript: 🚀 Meta Just Killed Open Source Llama: Welcome to the 'Muse Spark' Era (And What It Means for Developers)

15s

I rebuilt my VS Code setup from scratch this year, and it's the fastest it's ever been

🖼️

0

I rebuilt my VS Code setup from scratch this year, and it's the fastest it's ever been

XDA·Ayush Pande·4 months ago

#Gd39Aqwl

#sensa #community #code #extensions #coding #llama

From XDA Developers: I rebuilt my VS Code setup from scratch this year, and it's the fastest it's ever been

15s

Why Local AI Should Be the Default for Developers in 2026

🖼️

0

Why Local AI Should Be the Default for Developers in 2026

DEV Community·pickuma·4 months ago

#ny0JGBq6

#ai #webdev #tutorial #productivity #local #model

The case for running models on your laptop instead of paying per-token API bills: where local AI (Ollama, LM Studio, llama.cpp) wins on cost, latency, and privacy, and where the cloud still earns its keep.

15s

One AI Model Scored 99. I Still Voted for the One That Scored 95.

🖼️

0

One AI Model Scored 99. I Still Voted for the One That Scored 95.

DEV Community·Sukriti Singh·4 months ago

#O4L9QwiR

#ai #programming #career #discuss #claude #llama

Claude scored higher. Llama felt better in the browser. The harder part was figuring out...

15s

How to Deploy Llama 3.2 90B with vLLM + Speculative Decoding on a $16/Month DigitalOcean GPU Droplet: 2.5x Faster Inference at 1/110th Claude Cost

🖼️

0

How to Deploy Llama 3.2 90B with vLLM + Speculative Decoding on a $16/Month DigitalOcean GPU Droplet: 2.5x Faster Inference at 1/110th Claude Cost

DEV Community·RamosAI·4 months ago

#pACPdpCa

#programming #tutorial #ai #fullscreen #llama #vllm

From Dev.to - tutorial: How to Deploy Llama 3.2 90B with vLLM + Speculative Decoding on a $16/Month DigitalOcean GPU Droplet: 2.5x Faster Inference at 1/110th Claude Cost

15s

Local Multimodal LLM on iOS with `llama.cpp` (Swift + ObjC++)

🖼️

0

Local Multimodal LLM on iOS with `llama.cpp` (Swift + ObjC++)

DEV Community·Timothy Fosteman·4 months ago

#8E5wlXCv

#import #swift #ai #ios #framework #llama

I want a real local pipeline: image in, structured JSON out, no cloud dependency. Optimized to run...

15s

Menu

llama.app - Official home for llama.cpp

Ferrox: Building a Rust Inference Engine That Matches llama.cpp

Petals – Run LLMs at home, BitTorrent-style

GitHub - marcelroed/gigatoken: Language model tokenization at GB/s

How to Setup a Local Coding Agent on macOS

How to Deploy Llama 3.2 with TensorRT-LLM + Quantization on a $14/Month DigitalOcean GPU Droplet: 3x Faster Inference at 1/95th Claude Cost

I replaced cloud LLMs with local models running off a Proxmox LXC, and the performance trade-off was worth it

I'm 15, Built My First Real Project in 4 Days, and Put It on Gumroad

Llama Lounge 25 at Stanford, standing room only - Jeremiah Owyang

Llama 4 is now available on Vercel Marketplace - Vercel

How We Built Europe’s Trusted AI Resource for 2026 (And Why It Matters)

Ship Your SaaS for Free: OpenRouter’s Hidden Superpower

I ran this bulky LLM on an SBC cluster, and it's the most unhinged setup I've ever built

LLaMA.cpp Gets Qwen MTP Boost, Ring-2.6-1T for Ollama, AMD GPU Fixes

🚀 Meta Just Killed Open Source Llama: Welcome to the 'Muse Spark' Era (And What It Means for Developers)

I rebuilt my VS Code setup from scratch this year, and it's the fastest it's ever been

Why Local AI Should Be the Default for Developers in 2026

One AI Model Scored 99. I Still Voted for the One That Scored 95.

How to Deploy Llama 3.2 90B with vLLM + Speculative Decoding on a $16/Month DigitalOcean GPU Droplet: 2.5x Faster Inference at 1/110th Claude Cost

Local Multimodal LLM on iOS with `llama.cpp` (Swift + ObjC++)