• fartsparkles@lemmy.world
    link
    fedilink
    English
    arrow-up
    10
    arrow-down
    1
    ·
    5 days ago

    AI is a magical black box that performs a bunch of actions to produce an output. We can’t trust what a developer says the black box does inside without it being completely open source (including weights).

    This is a concept for a system where the actions performed can be proved to those who don’t have visibility inside the box to trust the box is doing what it is saying it’s doing.

    An AI enemy that can prove it isn’t cheating by providing proof of the actions it took. In theory.

    Zero Knowledge Proofs make a lot of sense for cryptography but in a more abstracted sense like this, it still relies on a lot of trust that the implementation generates proofs for all actions.

    Whenever I see Web3, I personally lose any faith in whatever is being presented or proposed. To me, blockchain is an impressive solution to no real problem (except perhaps border control / customs).

    • AtHeartEngineer@lemmy.worldOP
      link
      fedilink
      English
      arrow-up
      2
      ·
      5 days ago

      Zk in this context allows someone to be able to thoroughly test a model and publish the results with proof that the same model was used.

      Blockchain for zk-ml is actually a great use case for 2 reasons:

      1. it’s a public immutable database where people can commit to the hash of some model they want to hide.
      2. It allows someone with a “model” (that doesn’t have to be a neural net, it could be some statistical computation) and verifier to do work for others for a fee. Let’s say I have a huge data set of property values/data for some given area, and I’m a real estate agent, and I want to have other people run some crazy computation on it to predict which houses will likely sell first in the next 30 days. I could post this challenge online with the data, other people could run models against that data and post their results (but not how they got them) on chain. In 30 days the real estate agent could publish the updated data and reward the best performer, and potentially “buy” their model. You could do this with a centralized service, but they would likely take a fee, keep things proprietary, and likely try to make some shady back room deals. This removes the middleman.