Microsoft Phi-3.5 Sets New AI Standards, Grok-2 Shines in Chatbot Arena, and ‘Living Drug’ Offers New Hope

---

In this Issue

1. Microsoft's Phi-3.5 Series Storms the AI Arena

2. V2X Technology: Revolutionizing Road Safety and Efficiency

3. Grok-2 Achieves Second Place in Chatbot Arena Leaderboard

4. LLM Pruning and Distillation: The Minitron Approach

5. Newly Approved 'Living Drug' Offers Hope for Advanced Melanoma Patients

6. Polaris Dawn: Pushing Boundaries in Private Space Exploration

7. NVIDIA's Hot Chips 2024: Advancing AI and Chip Design

8. Chinese Startup AGIBOT Unveils Advanced Humanoid Robots

---

Microsoft's Phi-3.5 Series Storms the AI Arena

Microsoft's Phi-3.5 series is making a bold entry into the AI landscape, now available on Hugging Face, and it promises to challenge industry leaders like Google's Gemini 1.5 Flash and Meta's Llama 3.1. Featuring models such as the Phi-3.5-mini-instruct and the Phi-3.5-MoE-instruct, this series is engineered for excellence in complex tasks, including multilingual processing and advanced reasoning. With its innovative Mixture of Experts (MoE) architecture, the Phi-3.5 series not only aims to deliver high efficiency but also sets the stage for a new era of versatile AI models that could redefine industry standards.

V2X Technology: Revolutionizing Road Safety and Efficiency

Vehicle-to-Everything (V2X) technology is transforming transportation by enabling real-time communication between vehicles, infrastructure, pedestrians, and networks. This groundbreaking system promises to prevent thousands of crashes annually, with the U.S. National Highway Traffic Safety Administration estimating a 13% reduction in traffic accidents through V2V systems alone. V2X enhances traffic efficiency by optimizing routes based on real-time data, reducing congestion and fuel consumption, while also supporting the development of autonomous vehicles by providing a more comprehensive understanding of their environment for quicker and more accurate decision-making in complex traffic scenarios.

Grok-2 Achieves Second Place in Chatbot Arena Leaderboard

Grok-2 has shown remarkable capabilities, achieving the #1 ranking in mathematical tasks while securing the #2 position in various other categories, including challenging prompts, coding, and instruction-following. Additionally, Grok-2-Mini has benefited from significant speed enhancements, now operating at twice the speed of its predecessor. This improvement was made possible by xAI’s inference team, who completely restructured the inference stack using SGLang, resulting in more efficient multi-host inference and improved accuracy.

LLM Pruning and Distillation: The Minitron Approach

Exciting advancements are underway in AI with the study on compressing Llama 3.1 8B and Mistral NeMo 12B models down to 4B and 8B parameters! The authors dive into innovative depth and width pruning strategies, resulting in models like Mistral-NeMo-Minitron-8B that deliver competitive performance on key benchmarks. Notably, fine-tuning teacher models on the distillation dataset has proven to enhance outcomes when original training data is unavailable.

Newly Approved 'Living Drug' Offers Hope for Advanced Melanoma Patients

The FDA has approved a revolutionary cancer treatment known as tumor-infiltrating lymphocyte (TIL) therapy, branded as Amtagvi, for advanced melanoma. This innovative "living drug" harnesses a patient’s own immune cells to target and eliminate cancer cells by extracting T cells from the tumor, expanding them in the lab, and reinfusing billions back into the body.

In clinical trials, approximately 32% of the 73 participants experienced significant tumor reduction or complete disappearance. Notably, some patients, like Toni English, saw their cancer vanish entirely. While the long-term effects are still under investigation, TIL therapy represents a promising advancement in treating solid tumors that are difficult to address with traditional immunotherapies. Researchers aim to enhance its efficacy and explore its potential for other cancer types, providing new hope for patients with limited options.

Polaris Dawn: Pushing Boundaries in Private Space Exploration

SpaceX's Polaris Dawn mission, launching on August 26, will send four astronauts through the Van Allen radiation belt for the first time in over 50 years. This five-day mission includes the first spacewalk by private astronauts, using SpaceX's new EVA suits. The crew will conduct over 30 experiments on the effects of microgravity and radiation on the human body, focusing on bone density, muscle loss, and vision changes. Led by Shift4 CEO Jared Isaacman, Polaris Dawn showcases the capabilities of private space ventures and their role in advancing human spaceflight for future deep space missions.

NVIDIA's Hot Chips 2024: Advancing AI and Chip Design

NVIDIA is set to make waves at Hot Chips 2024, showcasing groundbreaking advancements in AI and chip design. The conference will feature presentations on NVIDIA's latest innovations, including the Grace Hopper Superchip and the Hopper GPU architecture. These technologies are pushing the boundaries of AI performance and energy efficiency, with the Grace Hopper Superchip offering unprecedented computational power for large language models and complex simulations.

Chinese Startup AGIBOT Unveils Advanced Humanoid Robots

AGIBOT, a Shanghai-based robotics startup founded by former Huawei "Genius Youth" recruit Peng Zhihui, has introduced a family of five advanced humanoid robots. The lineup includes both wheeled and biped models designed for various tasks from household chores to industrial operations.The flagship Yuanzheng A2 stands at 175cm, weighs 55kg, and can perform delicate tasks like needle threading. Equipped with AI-powered sensors, it can process visual, audio, and text information. AGIBOT aims to ship 300 units by the end of 2024, claiming superior commercialization and cost-control abilities compared to Tesla's Optimus.

And a quote…