Suumit Shah, the CEO of Bengaluru-based Dukaan, said the chatbot answered customer queries in 2 minutes — a task that took the humans over 2 hours.

  • realitista@lemm.ee
    link
    fedilink
    English
    arrow-up
    89
    arrow-down
    1
    ·
    1 year ago

    I’ve worked in customer service software companies for the last 30 years, and one thing I can tell you is that average handle time is not a good metric to decide your success or failure on.

    Having a low average handle time is easy. Just hang up on the customer. Or show them quickly that you won’t do shit for them so that they hang up on you.

    How about showing us those customer satisfaction and first call resolution scores?

    • Riskable@programming.dev
      link
      fedilink
      English
      arrow-up
      27
      ·
      1 year ago

      show them quickly that you won’t do shit for them so that they hang up on you.

      I do believe this is the reason why AI is so much faster than humans at this guy’s company.

      • DudePluto@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        ·
        edit-2
        1 year ago

        Reminds me of my local Rally’s switching to an “automated drive thru assistant.” The jank thing doesn’t even respond when you talk to it, just reminds you every 60 seconds that it’s ready when you are. First time I went I drove off. Went a second time thinking it might have been a fluke and I’d get actual human service. Nope. Guess I’ll be finding a new burger place for my hangovers

      • realitista@lemm.ee
        link
        fedilink
        English
        arrow-up
        7
        arrow-down
        1
        ·
        1 year ago

        This is so true. The ability for human beings to game any metric you put out there is pretty legendary. I’ve seen it in action so many times. Measure people on a single metric and they will sacrifice every other aspect of your business to make that metric look good.

        • LiquorFan@pathfinder.social
          link
          fedilink
          English
          arrow-up
          4
          ·
          1 year ago

          Reminds me of the story about the British India Company putting a bounty on snales to combat an infestation. People started breeding snakes to claim the bounties. When the government caught up to that, they stopped giving bounties for snales heads. So people released all their snakes into the wild, making the infestation worse than it was.

        • Moops@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          1
          ·
          edit-2
          1 year ago

          Isn’t the GDP itself a roll-up of dozens or hundreds of other metrics, making it nigh impossible to game? Gaming the metric is the problematic part of identifying metrics to track performance being referred to.

          • UnknownQuantity@lemmy.world
            link
            fedilink
            English
            arrow-up
            1
            ·
            1 year ago

            No, GDP (gross domestic product) is an amount of money produced by states’ economy. That’s why you can have falling wages and lots of people in poverty yet if the stock market is doing well the government can boast how everything is just fine.

    • Vlhacs@reddthat.com
      link
      fedilink
      English
      arrow-up
      5
      ·
      1 year ago

      If the majority of the service requests are that quick, then it’s probably something you can automate or by providing a knowledge base. It’s the complex problems that require a human and I see us needing that for the foreseeable future

      • realitista@lemm.ee
        link
        fedilink
        English
        arrow-up
        2
        ·
        1 year ago

        Yes well we will never know any of that based on the metrics he’s using to define success.

  • EndOfLine@lemmy.world
    link
    fedilink
    English
    arrow-up
    70
    ·
    1 year ago

    Did I miss the part about customer satisfaction? Guy could have just moved from solving customer issues in 2 hours to aggravating and loosing customers in under 2 minutes.

    • IDatedSuccubi@lemmy.world
      link
      fedilink
      English
      arrow-up
      27
      ·
      1 year ago

      Yeah, like, how do you even help someone in two minutes?? They probably just see “oh, it’s a bot” and leave

  • ArkyonVeil@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    47
    arrow-down
    1
    ·
    1 year ago

    Without any ratings for customer satisfaction. I might as well sack the entire support staff, don’t bother with AI and I’ll get a answered query to F off in 0 minutes and 100% savings.

    • Pika@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      ·
      edit-2
      1 year ago

      I mean this is what teslas PR email does, or is it Twitter… it’s one of those lol

      • Calcium5332@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        1 year ago

        I think it’s twitter. Journalists often contact twitter because of controversies, and they try to highlight that Twitter always says nothing useful

  • pulaskiwasright@lemmy.ml
    link
    fedilink
    English
    arrow-up
    24
    ·
    edit-2
    1 year ago

    This fails to say by what metric the bots are more efficient. Unless it’s just time-to-first-response. That’s the only metric referenced and it’s a stupid one if it’s the only metric.

  • CitizenKong@lemmy.world
    link
    fedilink
    English
    arrow-up
    13
    arrow-down
    2
    ·
    edit-2
    1 year ago

    I’m pretty sure most of those layoffs that are contributed to AI are just dumb CEOs that a) buy into the hype that AI makes human workers superflous (which is just completely wrong at this point) and b) just needed a reason to fire a few people to get a bonus.

    • pachrist@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      ·
      1 year ago

      It was interesting that the stats they were talking about were time to respond and time to close, which are both key customer service stats. I’d be interested to know what the customer satisfaction rating was.

      If I message, and someone answers immediately, but I figure out it’s a bot and I’m not getting anywhere after a minute, I stop and leave a bad review. From a time standpoint, the interaction looks great. When you integrate the CSAT score, it’s terrible. A quick response contributes to a good interaction, but it doesn’t make it good outright, unless you don’t actually care about whether customers are helped.

  • DpwnShift@lemmy.world
    link
    fedilink
    English
    arrow-up
    11
    arrow-down
    1
    ·
    1 year ago

    Another paragraph masquerading as an article. Ironically, probably written by AI…

  • vacuumflower@lemmy.sdf.org
    link
    fedilink
    English
    arrow-up
    4
    ·
    1 year ago

    I like how that free market suddenly starts working now with technologies allowing idiots to kill themselves that easily.

    It just has to stay more agile than the big guys and this really does work.

    • realitista@lemm.ee
      link
      fedilink
      English
      arrow-up
      38
      arrow-down
      1
      ·
      1 year ago

      Because he’s only measuring how long the interactions were, not whether anything was accomplished for the customer or whether the customer was happy.

      You know the easiest way to have a short interaction with a customer? Just hang up on them. Or piss them off quickly so they hang up on you.

    • bobs_monkey@lemm.ee
      link
      fedilink
      English
      arrow-up
      10
      arrow-down
      52
      ·
      edit-2
      1 year ago

      Because according to Reddit and Twitter, CEO = Bad. More than likely people are just knee-jerk reacting to the headline without reading the headline that says 90% of a company’s staff lost their job to a chatbot.

      The guy employed 60 people, almost half of which were support staff (26 people, less the 23 that got laid off). I’m assuming this was a text-based support link, so yeah if this guy could get his customers better support (2 min via chatbot vs 2 hours via live person), and the results are satisfactory, I’d do the same thing.

      Some people on the internet seem to think that companies are supposed to be job charities, while failing to realize that put in the same position, they’d do the exact same thing.

      Edit: Clearly this didn’t go over very well. I’m not trying to say that letting those people go is a win for society, or that I welcome our AI overlords to displace our jobs. My point is that from a business standpoint, if an effective solution saves the company money, any company would be somewhat foolish not to implement it. And truth be told, this is only the beginning of the labor market in the coming years. It would be in everyone’s best interest to develop skills that are much more difficult to be replaced by a computer.

      • reddwarf@feddit.nl
        link
        fedilink
        English
        arrow-up
        25
        arrow-down
        2
        ·
        1 year ago

        job charities

        So can we then dispel the capitalist notion that they are “job creators”?
        Clearly this is not the case as we see here, you even seem to cheer this sacking jobs on as a good thing.

        • bobs_monkey@lemm.ee
          link
          fedilink
          English
          arrow-up
          5
          arrow-down
          3
          ·
          edit-2
          1 year ago

          No, I do agree that capitalists are job creators, for better or worse (and I do wish our society wasn’t constructed the way it is, but that’s a different thing all together), but that isn’t the point I was intending on addressing. My implication on this particular instance is that, as a business owner, the guy found a solution to improve customer response time (2 min vs 2 hours), and that it was apparently successful enough that he felt that those jobs weren’t necessary. Don’t get me wrong, it’s a major bummer to those 23 people who now have to find new jobs, nor would I ever celebrate someone losing their income. But if they’re were that easily replaced by a computer, it’s hard to say those jobs were in fact necessary. Almost a bullshit jobs conundrum (David Graeber). Hopefully they find something more fulfilling. I know this sounds very anti-human, and that is not my intent. I’m saying all this from an objective business standpoint.

      • motorwerks@sopuli.xyz
        link
        fedilink
        English
        arrow-up
        15
        ·
        1 year ago

        I believe you’re simplifying the situation a bit & overlooking all aspects of ‘job performance.’ I do agree w/ your sentiment that jobs are/should not be a given, but from what I know about AI I’m struggling to believe it’s ready for nuanced roles in customer service.

        • bobs_monkey@lemm.ee
          link
          fedilink
          English
          arrow-up
          2
          ·
          1 year ago

          I was thinking technical questions about the software or UX, like “where is setting X” or "how do I achieve LMNOP, or perhaps questions with billing and such. I did a customer support job years ago after high school, and most of the questions were basic RTFM type things that people had either overlooked or just didn’t read the manual, and left me bored out of my mind. Sure, for more technical or in depth questions, it makes sense to talk to a person, and I’d assume that’s why the guy kept 3 people. Clearly my previous comment ruffled some feathers.