• 3 Posts
  • 22 Comments
Joined 2 years ago
cake
Cake day: June 5th, 2023

help-circle




  • qantravon@lemmy.worldtoTechnology@lemmy.world*Permanently Deleted*
    link
    fedilink
    English
    arrow-up
    13
    arrow-down
    1
    ·
    3 months ago

    I really hate that people keep treating these LLMs as if they’re actually thinking. They absolutely are not. All they are, under the hood, is really complicated statistical models. They don’t think about or understand anything, they just calculate what the most likely response to a given input is based on their training data.

    That becomes really obvious when you look at where they often fall down: math questions and questions about the actual words they’re using.

    They do well on standardized math assessments, but if you change the questions just a little, to something outside their training data (often just different numbers or a slightly different phrasing is enough), they fail spectacularly.

    They often can’t answer questions about words at all (how many 'R’s in ‘strawberry’, for instance) because they don’t even have a concept of the word, they just have a token that represents that word, and a list of associations that they use to calculate when to use that word.

    LLMs are complex, and the way they’re designed means that the specifics of what associations they make and how they’re weighted and things like that are opaque to us, but that doesn’t mean we don’t know how they work (despite that being a big talking point when they first came out). And I really wish people would stop treating them like something they’re not.








  • Vorik and Tuvok both claim the problem can be dealt with through meditation, but both of them also fail to resolve the issue in this way, so we don’t know if that’s actually an effective treatment.

    There’s also lots of ways a Vulcan could end up single, not to mention we’ve seen at least two instances of Vulcans rejecting their arranged marriages (T’Pol and T’Pring), so there’s no guarantee any given Vulcan has a mate, despite their customs.








  • Their ToS did say that updates would only apply to the current major version and newer of Unity when the updated ToS was released, but they removed that clause without telling anyone about a year ago and are claiming their changes are retroactive, so that can’t even be trusted. At this point, I can’t see any game dev beginning work on a new Unity project ever again without some kind of ironclad guarantee that this would never happen again. My prediction is we’ll see maybe 1 or 2 years of games released on Unity, just from the ones that were already too far into development to start over on something else, and then Unity is done for good.