Apparate: Early-Exit Models for ML Latency and Throughput Optimization – Early-Exit Models

:::info Authors: (1) Yinwei Dai, Princeton University (Equal contributions); (2) Rui Pan, Princeton University (Equal contributions); (3) Anand Iyer, Georgia Institute of Technology; (4) Ravi Netravali, Georgia Institute of Technology. ::: Table of Links Abstract and 1 Introduction 2 Background and Motivation and 2.1 Model Serving Platforms 2.2 Early-Exit Models 2.3 Challenges 3 Design 3.1 … Read more

Meat replacement startup Heura has a new mission to slay junk food with healthier plant-based swaps

The offices of plant-based protein startup Heura are tucked away down a narrow street a short distance from one of Barcelona’s main tourist draws. But the team of entrepreneurs and food scientists won’t be remixing their protein cocktails in close proximity to La Sagrada Família for much longer — they’re moving to new, larger digs … Read more

EU’s DSA enforcers send more questions to Snapchat, TikTok and YouTube about AI risks

On Wednesday, the European Union requested more information from Snapchat, TikTok and YouTube about their respective algorithms for content recommendation, activity that falls under the bloc’s online governance rulebook, the Digital Services Act (DSA). In a press release the Commission said it’s sent requests for information (RFI) to the three social media platforms asking them … Read more

Apparate: Early-Exit Models for ML Latency and Throughput Optimization – Background and Platforms

:::info Authors: (1) Yinwei Dai, Princeton University (Equal contributions); (2) Rui Pan, Princeton University (Equal contributions); (3) Anand Iyer, Georgia Institute of Technology; (4) Ravi Netravali, Georgia Institute of Technology. ::: Table of Links Abstract and 1 Introduction 2 Background and Motivation and 2.1 Model Serving Platforms 2.2 Early-Exit Models 2.3 Challenges 3 Design 3.1 … Read more

Apparate: Early-Exit Models for ML Latency and Throughput Optimization – Abstract and Introduction

:::info Authors: (1) Yinwei Dai, Princeton University (Equal contributions); (2) Rui Pan, Princeton University (Equal contributions); (3) Anand Iyer, Georgia Institute of Technology; (4) Ravi Netravali, Georgia Institute of Technology. ::: Table of Links Abstract and 1 Introduction 2 Background and Motivation and 2.1 Model Serving Platforms 2.2 Early-Exit Models 2.3 Challenges 3 Design 3.1 … Read more

Microsoft Office 2024 is now available for Macs and PCs

Image: Microsoft Microsoft is releasing a new version of Office this week, designed for people that don’t want to subscribe to Microsoft 365. The standalone Microsoft Office 2024 release is now available for both consumers and small businesses, and includes locked-in-time versions of Word, Excel, PowerPoint, OneNote, and Outlook across both Mac and PC. Office … Read more