Skip to content
AI NEWS JOURNAL
AI, IN PERSPECTIVE

Search AI news

Search headlines, summaries and articles to connect the dots.

Newest first

b12480

The Llama UI design system, including tokens, surfaces, fonts, and base components, has been moved from a temporary repository to ui/lib/ui, where it is now published as @ggml-org/llama-ui. Llama Chat now imports all UI elements—including model components, constants, enums, and helpers—from this centralized library, eliminating duplicate code. The update includes updated branding with Llama Sans and Llama Mono fonts, improved submenu rendering, enhanced elevation for chat form elements, and integration with the llama-brand package for colors and logo. The UI is now consistently applied across the application, with builds and deployment configurations adjusted accordingly.

b12489

A fix has been implemented to return a 400 error when both grammar and ignore_eos parameters are enabled in the server, preventing crashes and improving validation by moving the check into the sampler. Redundant tests have also been removed.

b12493

The update enables the fast implicit GEMM path for F32 kernels in CUDA, previously limited to F16, by converting input data to F16 in a pool buffer and using F32 accumulation, significantly improving performance for large channel counts.

Build WhatsApp AI agents with Amazon Bedrock AgentCore

SMART, an open-source Python SDK and Terraform stack, deploys the full WhatsApp channel layer to your AWS account with one command. Bring any agent that runs on Amazon Bedrock AgentCore, and SMART handles webhook ingestion, media, conversation memory, scheduling, and Meta message templates.

Monitor GitHub Copilot activity through Microsoft Agent 365

Enterprises can now stream GitHub Copilot agent activity directly into Microsoft Agent 365. This lets you bring audit data from across GitHub Copilot clients into Microsoft’s agent control plane, where… The post Monitor GitHub Copilot activity through Microsoft Agent 365 appeared first on The GitHub Blog.

b12445

The update introduces support for split_k in conv3d operations using Vulkan, leveraging a 256x128 shape (coopmat2-only) when beneficial and reusing the mul_mat split_k reduce shader.

b12451

The web UI for Llama.cpp has been relocated from tools/ui to ui/apps/chat as part of a structural refactoring to separate the component library (ui/lib) from the applications built on it. The app is now officially named Llama Chat, with its package renamed to @ggml-org/llama-chat, while maintaining private status. Documentation, help text, comments, and other references have been updated to reflect the new name, though legacy identifiers remain unchanged for backward compatibility.

b12456

The update addresses three issues in the OpenCL implementation of the bin flash-attention prefill path: releasing a previously unreleased WMM flash-attention mask fallback image, excluding q8_0 K/V at head size 512 from the WMM kernel due to incorrect results, and preventing the use of the WMM path beyond device 3D image limits to avoid clCreateImage failures.

b12474

The llama.cpp release b12474 introduces the application of output projection weight scale and provides precompiled binaries for multiple platforms including macOS, Linux, Windows, Android, and openEuler, supporting various backends such as CUDA, Vulkan, ROCm, OpenVINO, and SYCL.

b12475

The Llama Chat UI has been upgraded to SvelteKit 3, integrating its built-in service worker for improved update detection and offline functionality. The migration includes updates to Vite 8, TypeScript 6, Storybook 10, and ESLint 10, along with the replacement of deprecated packages and resolution of npm audit issues through dependency overrides, including pinning minimatch to version 11.0.5 to address a security vulnerability. Changes also align with current Svelte patterns, such as using $state instead of stores and adopting new syntax for actions and class bindings.

Introducing eve 1.0

Vercel announces the general availability of eve 1.0, an open-source framework for building production-ready agents. The release includes performance improvements, expanded integrations, enhanced observability via OpenTelemetry, and new features like multi-tenant support, persistent memory, multiplayer sessions, and lower workflow costs. eve enables developers to build agents with customizable workflows, native UI integrations with frameworks like Next.js, and secure, scalable deployments on Vercel. Early adopters report significant gains in development speed, reduced codebases, and lower AI costs.