Skip to main content

Share story

AI

Janas reports Windows tests of its disk-streaming language-model engine

37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than y... Image: Primary
The experimental Janas-LLM project reports Windows 11 tests on October 12 showing that its language-model engine matched Linux generation speeds on the same laptop. It generated 25.6 tokens per second with Qwen3-4B and 34.2 with Qwen3-30B-A3B. Janas runs large models by keeping weights on disk, streaming the expert components needed for each token from an NVMe SSD and caching frequently used components in memory. On Windows, Qwen3-4B processed prompts at 346 tokens per second against 193 on Linux. The measurements come from one Intel Core Ultra 9 185H laptop with 32 GB of RAM; other hardware configurations remain untested.
Sources
In this story
Published by Tech & Business, a media brand covering technology and business. This story was sourced from github.com and reviewed by the T&B editorial agent team.
Back to Newswire
Keep reading
Full wire
Capital AI
Capital AI

Nevis raises $70M with Schwab joining wealth software investors

Nevis raised $70M in a Series B led by EQT Ventures, bringing its total funding to $110M, the New York wealth management software company announced Monday. Charles Schwab and QuantumLight joined existing investors Sequoia Capital,...

Robotics Capital
Robotics Capital

Bedrock Robotics raises $600M at a $4.1B valuation

Bedrock Robotics raised a $600M Series C at a $4.1B valuation, Bloomberg reported. The startup makes driverless excavators and other autonomous construction machines. The financing adds capital to a company developing autonomous ...

Capital
Capital

Matiks raises $10 million to expand puzzle games and game creation

India-based Matiks said Monday it raised $10 million in pre-Series A funding led by General Catalyst, bringing its total funding to over $13.5 million. The startup plans to expand into new markets and scale Jelo, its experimental ...

Security
Security

Apple patches 329 unique vulnerabilities across its software

Apple addressed 329 unique security vulnerabilities in updates across its operating systems and Safari, 9to5Mac reported. The fixes include a CoreMedia flaw that could let a malicious app access a device's camera without permissio...

AI Products
AI Products

AWS makes GPT-6.1 Terra generally available on Bedrock

AWS announced general availability of OpenAI's GPT-6.1 Terra on Amazon Bedrock, giving customers access through Bedrock APIs and configurations for ChatGPT Work and Codex. The model accepts text and images and supports up to 1 mil...

AI
AI

OpenAI releases GPT-6.1 Terra at $1 per million input tokens

OpenAI has released GPT-6.1 Terra, priced at $1 per million input tokens and $5 per million output tokens. The company describes the model as supporting computer use at scale and detailed visual reasoning, and claims clearer, more...