Apparate: Early-Exit Models for ML Latency and Throughput Optimization – Implementation

:::info Authors: (1) Yinwei Dai, Princeton University (Equal contributions); (2) Rui Pan, Princeton University (Equal contributions); (3) Anand Iyer, Georgia Institute of Technology; (4) Ravi Netravali, Georgia Institute of Technology. ::: Table of Links Abstract and 1 Introduction 2 Background and Motivation and 2.1 Model Serving Platforms 2.2 Early-Exit Models 2.3 Challenges 3 Design 3.1 … Read more

FCC is offering $200 million to protect schools and libraries from hackers

Illustration: Beatrice Sala The Federal Communications Commission is making up to $200 million available to help schools and libraries make their computer systems more secure. The Schools and Libraries Cybersecurity Pilot Program will be used to evaluate whether to fund this kind of program on a more permanent basis. The funding will come through a … Read more

This Week in AI: OpenAI is stretched thin

Hiya, folks, welcome to TechCrunch’s regular AI newsletter. If you want this in your inbox every Wednesday, sign up here. After a brief hiatus, we’re back with a few show notes on OpenAI’s DevDay. The keynote yesterday morning in San Francisco was remarkable for its subdued tone — a contrast to the rah-rah, hypebeast-y address from … Read more

Apple is bringing back Sugar for season 2

Image: Apple Another beloved Apple TV Plus show is getting a second season. The streamer announced today that the detective series Sugar, which stars Colin Farrell in the titular role, has been renewed for season 2. It’s not clear yet when the show will return. Sugar debuted earlier this year. And while it started out … Read more

FOMO HOUR 210 – MIDDLE EAST TENSIONS RISE

Crypto drops as Middle East tensions flare. $500m liquidations in drop. BTC ETFs see largest outflows in a month. Fidelity ETH ETF sees 2nd highest outflow ever. SUI hits 6-month highs, bridge goes live on mainnet. Hashdex set to launch XRP ETF. Wormhole leads altcoin gains after Upbit lists. BTC miners hit record low profits … Read more

OpenAI raises $6.6B and is now valued at $157B

ChatGPT maker OpenAI has closed the largest VC round of all time. The startup today announced that it raised $6.6 billion in a funding round that values OpenAI at $157 billion post-money. Led by previous investor Thrive Capital, the new cash brings OpenAI’s total raised to $17.9 billion, per Crunchbase. Thrive invested around $1.3 billion, … Read more

Apparate: Early-Exit Models for ML Latency and Throughput Optimization – Latency-Focused Adjustments

:::info Authors: (1) Yinwei Dai, Princeton University (Equal contributions); (2) Rui Pan, Princeton University (Equal contributions); (3) Anand Iyer, Georgia Institute of Technology; (4) Ravi Netravali, Georgia Institute of Technology. ::: Table of Links Abstract and 1 Introduction 2 Background and Motivation and 2.1 Model Serving Platforms 2.2 Early-Exit Models 2.3 Challenges 3 Design 3.1 … Read more

Amazon’s new Fire tablets have AI inside

Image: Amazon Amazon just announced a new Fire HD 8 tablet, and like many new gadgets in 2024, generative AI-powered tools are among the big new features. But you won’t necessarily need to buy the new Fire HD 8 to try them; Amazon says they’re coming to the Fire HD 10 and Fire Max 11 … Read more

Facebook says it paid content creators $2B this year

Are creators sleeping on Facebook? Though the social network has been more enticing for AI Shrimp Jesus than young people, Facebook is consolidating its monetization programs into a more streamlined Facebook Content Monetization hub, which will reward creators for their Reels, longer videos, photos and text posts. This change could incentivize more creators to work … Read more