• 0 Posts
  • 23 Comments
Joined 3 months ago
cake
Cake day: June 4th, 2025

help-circle
  • You’d have to be entirely brainless to look at this landscape and think your hard work is going to “pay off” in any significant way.

    That “hard work” gets milked at every job. Your “hard work” is just “meets expectations” on your quarterly review and that’s why you won’t see a cost of living raise this year. Maybe if you work harder next year? And don’t take any time off?

    And then you see the billionaire class spending more money with a wave of their hand than you’ll ever see in your life. More than your entire community could pool together in your collective lifetimes. The billionaires didn’t “work hard” for it. They were born into it. Then you’ll see that massive waste of money implode at the bottom of the sea and wonder why people go hungry.

    If you’re going to work hard - make sure it’s for yourself / someone you care about. Employers are here to take advantage of you.














  • From the original post:

    Sure, they have huge GPU clusters, but there must be more going on - model optimizations, sharding, custom hardware, clever load balancing, etc.

    What engineering tricks make this possible at such massive scale while keeping latency low?

    The amount of hardware they’re using is far more than you’re imagining, x1000. To answer your question as simply as possible: Money. Money to buy nuclear power plants to power this specific technology. Money to market & sell the idea. Money to lobby for legislation so it can keep sucking up copyrighted works. Money, money, and money is the reason why these companies can run this stuff while OP cannot.

    Also, and mostly just my own paranoia - I don’t trust anything these LLM companies are saying. Their entire product is running on hype right now. Every one of these companies is dumping absurd amounts of money into something that barely works, and there’s no incentive for them to be honest with any of it. If the hype doesn’t perpetuate, they’ve wasted that money.