• 2 Posts
  • 677 Comments
Joined 2 years ago
cake
Cake day: June 11th, 2023

help-circle
  • Unless we invent cold fusion between the next 5 years, they will never be economical. They are the most energy inefficient thing ever invented by humanity and all prediction models state that it will cost more energy, not less, to keep making them better. They will never be energy efficient nor economical in their current state, and most companies are out of ideas on how to shake it up. Even the people who created generative models agree that they have just been brute forcing by making the models larger with more energy consumption. When you try to make them smaller or more energy efficient, they fall off the performance cliff and only produce garbage. I’m sure there are researchers doing cool stuff, but it is neither economical nor efficient.


  • dustyData@lemmy.worldtoTechnology@lemmy.worldruh roh
    link
    fedilink
    English
    arrow-up
    5
    ·
    2 days ago

    Several tried. Nothing as elaborate as cross dissemination, federation or whatever. But at least 5 to 10 years ago it proved to be almost impossible. Platforms like Rooster teeth, which was 100% subscription based, I think never broke even and still relied on YT ads for the majority of the revenue. Some big and small channels tried to at least just catalog, archive and serve their own videos and the costs still became astronomical really fast. Whenever you see one of those very old channels, most of them don’t conserve copies, let alone original source footage of their entire material. Everyone just delete their videos once they’ve been on YouTube for a month or so now, and they have to download their own videos when they want to reuse old footage.

    Storage is cheap today, yes, but video really eats storage at an alarming rate. Specially now that 4k is the standard. So you have to reuse storage over and over. Transcoding is also really fast and optimized with modern algorithms, but it takes specialized graphical cards and data centers charge a premium to use servers with such capacities. Self hosting will never be able to satisfy a moderate demand. Get anything above 100 users simultaneously transcoding videos and a non-specialized server will halt to a grind just on IO calls to hard drives alone.

    Once you consider all those factors it is obvious why YouTube is such a miracle.






  • Indeed, the formal definition actually doesn’t specify how many monkeys will write what given an infinite number of monkeys, it’s unknowable (that’s just how probability is). We just know that it will almost surely happen, but that doesn’t mean it will happen an infinite amount of occurrences.

    The infinite amount of time version is just as vague, one monkey will almost surely type a specific thing, eventually, given infinite time to type it. This is because when you throw infinites at probability, all probabilities tend to 1. Given an infinite amount of time, all things that can happen, will almost surely happen, eventually.




  • dustyData@lemmy.worldtoTechnology@lemmy.worldThe GPT Era Is Already Ending
    link
    fedilink
    English
    arrow-up
    20
    arrow-down
    1
    ·
    15 days ago

    The whole point is that one of the terms has to be infinite. But it also works with infinite number of monkeys, one will almost surely start typing Hamlet right away.

    The interesting part is that has already happened, since an ape already typed Hamlet, we call him Shakespeare. But at the same time, monkeys aren’t random letter generators, they are very intentional and conscious beings and not truly random at all.




  • Zodiac signs are about as accurate as tarot readings or reading tea leaves. They’re even wrong about what they are based on. The star locations and sun precession hasn’t coincided with the original 12 zodiac constellations for centuries. People use the dates and signs as they were set by astrology tradition ages ago, but the dates when the sun changes from one constellation to the next is also absolutely arbitrary to make it match exactly 4 and a half weeks.

    The personality descriptions for zodiac signs are textbook examples of cold reading. A technique of making intentionally ambiguous but agreeable affirmations so that people project their self-view onto the descriptions disregarding evidence or specifities.

    It is a superstition as it is the belief on the supernatural influence of the relative apparent position of stars in the sky over the behavior and personality of individuals. It’s a, mostly, harmless superstition, but superstitious none the less.




  • The only money to be made in the LLM craze is data scraping, collection, filtering, collation and data set selling. When in a gold rush, don’t dig, sell shovels. And AI needs a shit ton of shovels.

    The only people making money are Nvidia, the third party data center operators and data brokers. Everyone else running and using the models are losing money. Even OpenAI, the biggest AI vendor, is running at a loss. Eventually the bubble will burst and data brokers will still have something to sell. In the mean time, the fastest way to increase model performance is by increasing the size, that means more data is needed to train them.