#部署/工程

685 output tokens/s per user on @Alibaba_Qwen Qwen3.8-Flash-Next. Running TokenSpeed on 4× NVIDIA GB300 with NVFP4. A look at the kernel and serving optimizations behind the results: 👉 https://lightseek.org/blog/tokenspeed-qwen3-8-flash-next.html ⭐ https://github.com/lightseekorg/tokenspeed

vLLM now supports NVIDIA Vera Rubin. The early results show more than 7.8x the throughput of GB200 on MiniMax M3 on AgentX. @inferact, @NVIDIAAI, @RedHat_AI, and the vLLM community have been bringing vLLM up on Rubin since it was announced. Here is where things stand. 🧵 1/5

Today, we announced new @Windows platform capabilities and @surface devices built to empower people and organizations for the era of hybrid intelligence. Here are some of the highlights: - It all starts with trust. Microsoft Execution Containers (MXC) is now generally available on Windows 11, keeping agents contained within boundaries the operating system enforces. - HydraFusion brings hybrid intelligence to life, allowing models to run locally while seamlessly accessing the cloud when more scale or capability is needed. We're working with @github to extend HydraFusion to Windows. - This fall, Search on the taskbar adds thousands of quick actions, making it easier to adjust settings and get things done as fast as you can type. - @MSFTCopilot is getting more powerful on Windows. With hybrid intelligence, it can tap into your PC's local capabilities and turn your requests into action, while keeping you in control. - Local agents are coming to Windows too. Muse is on its way as a native Windows app with MXC integration, and Hermes, OpenClaw, and Perplexity are already building local experiences on Windows. - Surface Laptop Ultra, built with NVIDIA RTX Spark, is the most powerful Surface we've ever built. It's available for pre-order today, along with the Surface RTX Spark Dev Box and new RTX Spark PCs from our partners. Call of Duty is coming to RTX Spark in 2027. Read more on the Windows Blog: https://blogs.windows.com/windowsexperience/2026/10/07/building-windows-for-hybrid-intelligence/

DeepSeek Harness for desktop is now available on macOS and Windows. https://x.com/i/article/2104777189275439104

We're excited to offer Day0 OpenVINO support for Qwen-Image-2.1 Read more about what you can accomplish here: https://ms.spr.ly/6019a5nm5

Day-0 support for @Alibaba_Qwen’s Qwen-Image 2.1 is here in SGLang-Diffusion! 🖥️ Native precision on a single RTX 4090 24GB with CPU offload - 1024×1024 generation in 18.7s and image editing in 21.7s with 22.7 GiB peak GPU memory during requests. - On an RTX PRO 6000 96GB: 8.0s generation and 9.6s editing. 🎨 Text-to-image, multi-image editing, and transparent RGBA output—all with one checkpoint. ⚡ Native inference with TP/SP, LoRA, and OpenAI-compatible APIs. 40 denoising steps, one image per request, warmed HTTP latency including PNG output. No quantization. Cookbook and GPU-specific commands below 👇

Qwen-Image-2.1 from @Alibaba_Qwen has day-0 support in vLLM-Omni. 🎉 Generate, edit, and create transparent images with one model: a 7.1B DiT paired with Qwen3-VL-8B. Setup and supported combinations 👇 https://recipes.vllm.ai/Qwen/Qwen-Image-2.1

Qwen3.8-27B is now live at Cerebras speed. The dense, open-weight model from @Alibaba_Qwen scores 34 on the Artificial Analysis Intelligence Index—making it comparable to models such as GPT-5.6 Luna, DeepseekV4 Pro, and Claude Sonnet 4.6.

🔥DeepSeek-V4-Pro API is 75% OFF until May 5th, 2026, 15:59 (UTC Time)! Don't miss out on this massive discount. 🛠️Integration Updates: 🔹Claude Code: Set model to deepseek-v4-pro[1m] to unlock 1M context! 🔹OpenCode: Update to v1.14.24+ 🔹OpenClaw: Update to v2026.4.24+ Check the latest official API docs for full details: https://api-docs.deepseek.com/quick_start/pricing

When @karpathy built MenuGen (https://karpathy.bearblog.dev/vibe-coding-menugen/), he said: "Vibe coding menugen was exhilarating and fun escapade as a local demo, but a bit of a painful slog as a deployed, real app. Building a modern app is a bit like assembling IKEA future. There are all these services, docs, API keys, configurations, dev/prod deployments, team and security features, rate limits, pricing tiers." We've all run into this issue when building with agents: you have to scurry off to establish accounts, clicking things in the browser as though it's the antediluvian days of 2023, in order to unblock its superintelligent progress. So we decided to build Stripe Projects to help agents instantly provision services from the CLI. For example, simply run: $ stripe projects add posthog/analytics And it'll create a PostHog account, get an API key, and (as needed) set up billing. Projects is launching today as a developer preview. You can register for access (we'll make it available to everyone soon) at http://projects.dev. We're also rolling out support for many new providers over the coming weeks. (Get in touch if you'd like to make your service available.) https://projects.dev