Tag: LLM

RSAVQ enhances LLM quantization using Riemannian geometry, minimizing error & optimizing bit allocation for efficient deployment on resource-limited devices.

Explore Google's new open-source language model, Gemma! Learn about its efficient architecture & how it's democratizing AI access for developers ...

Tunix simplifies LLM post-training in the JAX ecosystem. This new library offers performance gains & modularity for LoRA/prefix tuning, accelerating ...

Promptfoo & Docker simplify LLM app evaluation. Docker Model Runner manages models, while the MCP Toolkit connects to AI agents. ...

AfriMed-QA is a new benchmark assessing large language models' ability to answer questions about African medical literature, addressing knowledge gaps ...

Learn how Writer and Premji Invest envision agentic AI's future: full-stack systems, adaptive models & IT-business collaboration at enterprise scale.

llama.cpp now pulls GGUF models directly from Docker Hub! Streamline AI model management and leverage versioning for reproducible results.

Deploy OpenAI GPT OSS models on SageMaker & Bedrock with LangGraph to build scalable agentic workflows like a stock analyzer.

Unlock the power of Large Language Models! Explore practical strategies for fine-tuning, deploying, and optimizing these AI giants to achieve ...

TII’s Falcon-H1 models now available on Amazon Bedrock & SageMaker JumpStart, offering exceptional performance & efficiency for developers.

Google's Speculative Cascades speeds up LLM inference by 3x using a hybrid approach of speculative decoding & cascaded verification. Learn ...

Discover how AI is revolutionizing the product development cycle, from ideation to testing. Learn about tools & strategies for PMs ...

Apertus, a new open-source multilingual language model from EPFL, ETH Zurich & CSCS, offers full transparency for developers & researchers ...

Skello uses Amazon Bedrock to power an AI assistant, simplifying workforce data access while ensuring GDPR compliance in a multi-tenant ...

Discover VaultGemma, Google's new differentially private LLM combining high performance with robust data privacy. Learn how it tackles the challenge ...

Explore how to leverage powerful artificial intelligence even without an internet connection! Discover practical strategies & tools for deploying and ...

Learn how Coveo Passage Retrieval API enhances LLM accuracy on Amazon Bedrock, providing grounded responses & rapid deployment of generative ...

Streamline AI model training & deployment with Amazon SageMaker HyperPod CLI/SDK. Learn practical examples of distributed training (FSDP) & inference.

LLMs are revolutionizing ML workflows! Discover 5 key ways to supercharge your processes: automated labeling, feature engineering, code generation & ...

Generative AI is poised to revolutionize healthcare, but rigorous evaluation is key to ensuring safety and accuracy. This framework provides ...

By aligning model serving with Kubernetes-native tooling, Gateway API Inference Extension aims to simplify and standardize how AI/ML traffic is ...

Unlock the full potential of Large Language Models with our proven optimization techniques. Drive efficiency and accuracy – discover how ...

Explore how to build your own decoder-only transformer model inspired by Llama 2 & 3. This guide covers building a ...