• Blackmist@feddit.uk
    link
    fedilink
    English
    arrow-up
    7
    ·
    2 days ago

    For the same reason that people were selling crypto mining boxes rather than just plugging them in:

    The only guaranteed profit in a gold rush is to be the one selling shovels.

    See Nvidia for details.

  • makingStuffForFun@lemmy.ml
    link
    fedilink
    arrow-up
    7
    arrow-down
    1
    ·
    2 days ago

    The reality is the product is the easy part.

    Actually selling it, maintaining it, selling more of it and running a profitable business is the hard part.

    So the AI makes the product really easy to make, but selling it is the hard part.

      • makingStuffForFun@lemmy.ml
        link
        fedilink
        arrow-up
        4
        arrow-down
        1
        ·
        2 days ago

        I do work for a software company, and sales is part of my job. And yes, sometimes I get the AI to review a tricky sale. Not usually though.

        However, the reality is it takes years and years to build relationships, get into markets, get visibility.

        Basically embed yourself into a market. So the product is the easy part. The sale is the hard part.

  • motruck@lemmy.zip
    link
    fedilink
    arrow-up
    60
    ·
    4 days ago

    In a gold rush it is better, on average, to sell the shovels then to mine the gold.

  • eksb@programming.dev
    link
    fedilink
    English
    arrow-up
    122
    arrow-down
    2
    ·
    4 days ago

    Because it is a scam. Just like the people selling, instead of using:

    • healing crystals
    • essential oils
    • blockchain
    • penis-enlargement pills
    • JIRA
  • pachrist@lemmy.world
    link
    fedilink
    English
    arrow-up
    8
    arrow-down
    1
    ·
    3 days ago

    The real reason isn’t that they can’t turn a profit, it’s that they don’t have to.

    They don’t have to be profitable because they aren’t fueling growth with profits, they’re fueling it with debt and investment. Like many have noted, they cannot do that forever and will eventually pass that cost to consumers. A significant portion of their existing cost is driven by research, which they can scale back by lobbying for legislation, so that peers getting a leg up is more difficult and small players catching up is almost impossible.

    Also, both Anthropic and OpenAI have planned IPOs, where they will inevitably raise a ton of cash. It’s a game of chicken though. How long can they fuel growth without being publicly accountable to balance sheets and shareholders? Whether we like it or not, they will almost certainly transition to being profitable businesses, but only when it is advantageous for them to do so. Right now, it’s not a priority; the priority is growth to the point of diminishing returns.

      • vaultdweller013@sh.itjust.works
        link
        fedilink
        arrow-up
        4
        ·
        2 days ago

        Nah mankind will continue, but it’ll definitely hurt when this shitshow implodes and possibly takes out the current economic model and quite a few governments with it.

  • Quacksalber@sh.itjust.works
    link
    fedilink
    arrow-up
    63
    ·
    4 days ago

    I’d wager it’s simply not possible to be profitable using AI for most use-cases. You either burn way too many tokens on your queries or risk your business falling victim to an under-tokenized AI hallucination.

      • Whitebrow@lemmy.world
        link
        fedilink
        arrow-up
        46
        ·
        4 days ago

        I love the assumption that if you spend enough tokens, it won’t hallucinate, like it isn’t a mathematical certainty or anything.

        • zod000@lemmy.dbzer0.com
          link
          fedilink
          arrow-up
          5
          ·
          3 days ago

          I agree with you, but I liken to to how companies tend to replace competence with bureaucracy. With enough layers, a significant amount of mistakes get caught. It just slows everything down and costs a bunch of money. There are still problems that get through, just less of them.

        • dragnucs@lemmy.mlOP
          link
          fedilink
          arrow-up
          6
          arrow-down
          19
          ·
          4 days ago

          You can cut hallucinations by 90% just by prompting the LLM to.not guess API and function names and to provide it with full docs or MCP to find docs.

          • athatet@lemmy.zip
            link
            fedilink
            arrow-up
            21
            arrow-down
            2
            ·
            4 days ago

            Yeah but it’s not guessing in the first place. It has zero reasoning skills. It just outputs the most likely next word. Even when you ‘tell it not to’

            • dragnucs@lemmy.mlOP
              link
              fedilink
              arrow-up
              8
              arrow-down
              17
              ·
              4 days ago

              I know I am getting down voted for this because people haven’t tried it. And let me differ, it has reasoning skills, it now gets beyond predicting the next word. And even reducing it to next word is some kind of primitive reasoning.

              By experience, by telling the AI to not guess APIs and function names and instead provide it with a way of looking through docs, and inspecting the code and other tools to get it do some tests, the hallucinations disappear. I’ve been able to have better results with this setup.

              This is very different than the “no mistakes” joke.

              • AdamBomb@lemmy.world
                link
                fedilink
                arrow-up
                1
                ·
                19 hours ago

                I’ll back you up on this. I’ve had the experience of seeing Claude fabricate stuff, and then when I challenge it, it says something like “I guessed, let me look deeper” and then it indeed does check deeper with docs or a configured LSP etc and then discovers the real answer.

                It doesn’t matter if this was the result of reasoning or just more pattern prediction, the result is that if you tell it not to guess, it responds appropriately.

              • spankysalmon@fedinsfw.app
                link
                fedilink
                English
                arrow-up
                11
                ·
                4 days ago

                “it has reasoning skills” Nope. It has larger context windows and someone coded in the ability to reprompt itself for “thinking” steps that are literally just a new prompt with the same context that gets fed back in which merely increases the chances of it guessing the next output token correctly.

                It still doesn’t “reason”. It still doesn’t know what the words mean. The modified algorithms are just attempting to generate the corrective prompts for you. If you’ve ever messed with them long enough, you’d understand that these, “no wait fix it” prompts have rapidly diminishing returns at the best of times. Their “thinking” is a bandaid, and a piss poor one at that.

              • CorrectAlias@piefed.blahaj.zone
                link
                fedilink
                English
                arrow-up
                10
                arrow-down
                2
                ·
                4 days ago

                I know I am getting down voted for this because people haven’t tried it.

                People here have tried it, LLM use is basically enforced at a ton of companies and the tech industry crowd is a huge portion of the population here.

                You’re likely being downvoted as you seem to have a fundamental misunderstanding of how LLMs function. LLMs don’t reason. LLMs don’t think. Telling an LLM to not guess might help ever so slightly, but LLMs can and do hallucate search results regularly.

                It’s a mistake to trust that LLMs aren’t hallucinating just because you told the LLM to not guess.

                • dragnucs@lemmy.mlOP
                  link
                  fedilink
                  arrow-up
                  4
                  arrow-down
                  3
                  ·
                  4 days ago

                  I juste don’t want to talk about this any more becausefor me adding those instructions in AGENTS.MD and giving it the full API and language and platform docs dropped significantly the hallucinations. You just disregarding my experience and want me to believe in your assumptions.

                • dragnucs@lemmy.mlOP
                  link
                  fedilink
                  arrow-up
                  2
                  arrow-down
                  6
                  ·
                  4 days ago

                  It doing sgupid stuff is another issue separate from hallucinations. Preventing LLM from doing dumb shit is more difficult, you need more guards and harnesses.

          • kestrel7_7@lemmy.world
            link
            fedilink
            arrow-up
            4
            ·
            3 days ago

            This logically leads to a similar question to OP’s again: if it’s so easy to cut down on hallucinations, then why haven’t the designers of this software already integrated that in?

    • im_fine_sandy@nord.pub
      link
      fedilink
      English
      arrow-up
      6
      ·
      4 days ago

      This is kinda fundamental to economics: the moment AI learns to perform some task, that task becomes less valuable.

        • im_fine_sandy@nord.pub
          link
          fedilink
          English
          arrow-up
          4
          ·
          3 days ago

          That’s the economists angle, yes, but that’s not what I’m getting at.

          You can’t make a business with AI because anyone can use an LLM to do anything an LLM can do.

          There are exceptions in the short term, but they may not last. For example, we’re paying a hefty subscription fee for an AI service that scrapes financial data from scanned pages. It’s much more accurate than traditional OCR.

          Presently its better than its competitors so commands a premium price. However, I don’t think it will enjoy that position for long.

  • fruitycoder@sh.itjust.works
    link
    fedilink
    arrow-up
    3
    ·
    2 days ago

    To be fair, a reasonable answer would be the same as any reseller or value-added business. They have some skill, capital, or existing market capture that the whole seller does not.

    Don’t get me wrong it can still be bullshit, but it’s actually pretty common.

  • Senal@programming.dev
    link
    fedilink
    English
    arrow-up
    24
    arrow-down
    1
    ·
    4 days ago

    This is exactly the question i ask “investment advisor” services when they call asking if i want help managing investments.

    For you to have a system that works well enough for me to be interested , there’d be no need for you to spend money on call centers full of people ringing up strangers for money, you could take all of that money and invest it in the plan you are trying to sell me.

    • zod000@lemmy.dbzer0.com
      link
      fedilink
      arrow-up
      3
      ·
      4 days ago

      I’ve always thought that as well. Surely it wouldn’t take them long to become ludicrously wealthy with their top investing acumen.

      • AdolfSchmitler@lemmy.world
        link
        fedilink
        arrow-up
        2
        ·
        3 days ago

        Ikr. If I knew a “foolproof” investing strategy to “make loads of money”, I wouldn’t spend my time trying to teach other people about it, id just be using that strategy myself and actually NOT want other people to know about it.

  • Grimy@lemmy.world
    link
    fedilink
    arrow-up
    35
    arrow-down
    1
    ·
    4 days ago

    If I recall correctly, shovel companies made a lot of money while only a few of their shovels actually struck gold.

    • Ephera@lemmy.ml
      link
      fedilink
      arrow-up
      19
      ·
      4 days ago

      Recent scholarship confirms that merchants made far more money than miners during the gold rush.
      The wealthiest man in California during the early years of the rush was Samuel Brannan, a tireless self-promoter, shopkeeper and newspaper publisher. Brannan opened the first supply stores in Sacramento, Coloma, and other spots in the goldfields. Just as the rush began, he purchased all the prospecting supplies available in San Francisco and resold them at a substantial profit.

      https://en.wikipedia.org/wiki/California_gold_rush

  • FriendOfDeSoto@startrek.website
    link
    fedilink
    English
    arrow-up
    39
    arrow-down
    2
    ·
    4 days ago

    When potatoes came over from the New World, a lot of Europeans grew them as decorative plants. New shit makes people do weird stuff.

    Not everybody is trying to make a business with so-called AI. The peddlers are just the loudest.

    The companies promise their models can do all this stuff for paying customers. If the models were truly that capable, the so-called AI companies ought to be doing everything with them and be raking in the dough like mad. Which they’re not because they know the limitations of the models. It’s what economists call the bullshit gap between marketing and reality. And by economists I mean me.

    • dragnucs@lemmy.mlOP
      link
      fedilink
      arrow-up
      9
      arrow-down
      1
      ·
      4 days ago

      I like your newly coined term: “marketing bullshit gap”. I will start using it.

      A agree with your point of view fully.

    • GalacticRobot@lemmy.world
      link
      fedilink
      arrow-up
      1
      arrow-down
      3
      ·
      3 days ago

      I mean if you were an economist you’d know exactly why AI companies are making massive profits, because its more profitable to sell shovels during the gold rush than it is to find gold. Doesn’t mean gold is worthless and not profitable, it’s pretty basic economics, but you know that already.

      • Jaysyn@lemmy.world
        link
        fedilink
        arrow-up
        9
        ·
        3 days ago

        I mean if you were an economist you’d know exactly why AI companies are making massive profits

        They are literally not making massive profits. They may be making lyin’ Sam Altman rich, but the VC money is drying up and OpenAI has repayments coming up in 2027 that it doesn’t have a chance in hell of being able to payback.

        https://www.wheresyoured.at/brokenomics/

          • Jaysyn@lemmy.world
            link
            fedilink
            arrow-up
            2
            ·
            3 days ago

            Yeah, but they aren’t an “AI company”. They are a hardware company that is propping up AI companies to keep them buying (and warehousing) GPUs via circular financing.