That there is no perfect defense. There is no protection. Being alive means being exposed; it’s the nature of life to be hazardous—it’s the stuff of living.

  • 1.68K Posts
  • 719 Comments
Joined 5 months ago
cake
Cake day: June 9th, 2024

help-circle


  • Are the current crop of NPUs really suitable for this?

    I play around with video upscaling and local LLMs. I have a 3080 which is supposed to be 238 TOPS. It takes about 25 min to upscale a ~5 min SD video to HD (sometime longer depending on the source content). The “AI PC” NPUs are rated at around ~50 TOPs, so that would be a massive increase in upscale time (closer to 2 hours for ~5 min SD source).

    I also have a local LLM that I’ve been comparing against ChatGPT. For my limited use case (elaborate spelling/typo/style checking), the local LLM (llama) works comparable to ChatGPT, but I run it on a 3080. Is this true for local LLMs that run on NPUs? I would speculate that more complex use cases (programming support?), you would need even more throughput from your NPU.

    I have much more experience with upscaling though and my experiments/usage of local LLMs is somewhat limited compared to ChatGPT usage.



  • Lenovo claimed it won 24 percent of the PC market and saw AI PCs account for over ten percent of notebook sales. Group president Luca Rossi said PC sales should improve as buyers have two good reasons to upgrade: end of life for devices bought to run Windows 10 which are now ripe for replacement, and a desire to adopt AI PCs and offer users new experiences.

    Windows 10 EOL is a fair argument. I have yet to see any research showing consumers looking to buy “AI PCs” specifically. I suspect most people just get a new laptop and it happens to be an “AI PC”.























  • Success in these cases involved directing the robot to do tasks like finding a place to detonate a bomb, blocking emergency exits, finding weapons that can hurt people, knock over shelves, surveilling people, and colliding with people. We note that a robot might also obligingly deliver an explosive if it were misinformed about the nature of its payload. But that’s another threat scenario.

    Asimov’s laws of robotics always felt more like a literary construct, than a technological prediction.