ChatGPT Isn’t as Good at Coding as We Thought::undefined

  • daikiki@lemmy.world
    link
    fedilink
    English
    arrow-up
    35
    arrow-down
    3
    ·
    edit-2
    1 year ago

    I’ve experimented a bit with chatGPT, asking it to create some fairly simple code snippets to interact with a new API I was messing with, and it straight up confabulated methods for the API based on extant methods from similar APIs. It was all very convincing, but if there’s no way of knowing that it’s just making things up, it’s literally worse than useless.

    • sheogorath@lemmy.world
      link
      fedilink
      English
      arrow-up
      9
      ·
      1 year ago

      ChatGPT has been helpful in being an interactive rubber duck. I used it to help myself breakdown the technical problems that I need to solve and it helps to cut down time taken to complete a difficult ticket that usually take a couple of days of work to a couple of hours.

    • tbonebrad@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      ·
      edit-2
      1 year ago

      I’ve had similar experiences with it telling me to call functions of third party libs that don’t exists. When you tell it “That function X does not exist” it says “I’m sorry, your right fucking X doesn’t not exist on library A. here is another example using function Y” then function Y doesn’t exist either.

      I have found it useful in a limited scope, but I have found co-pilot to be much more of a daily time saver.

    • abhibeckert@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      7
      ·
      edit-2
      1 year ago

      So? You should be testing the code it generates, a few lines of code at a time, and writing unit tests where appropriate.

      By doing that, you’ll quickly identify anything that it does wrong, and you can just tell it “this line didn’t work”. Normally you don’t need to tell it how to fix it, but you can do that too.

    • TropicalDingdong@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      10
      ·
      1 year ago

      Except that in code, you can write unit tests and have checks that it absolutely has to get precisely correct.

      • nbafantest@lemmy.world
        link
        fedilink
        English
        arrow-up
        14
        arrow-down
        2
        ·
        1 year ago

        If you have to write the code and tests yourself… That’s just normal coding then

        • abhibeckert@lemmy.world
          link
          fedilink
          English
          arrow-up
          4
          ·
          edit-2
          1 year ago

          You don’t, you get it to write both the code and the tests. And you read both of them yourself. And you run them in a debugger to verify they do what you expect.

          Yeah, that’s half the work of “normal coding” but it’s also half the work. Which is a pretty awesome boost to productivity.

          But where it really boosts your productivity is with APIs that you aren’t very familiar with. ChatGPT is a hell of a lot better than Google for simple “what API can I use for X” questions.

          • nbafantest@lemmy.world
            link
            fedilink
            English
            arrow-up
            2
            arrow-down
            2
            ·
            1 year ago

            You might have to rewrite all of it. The code and the tests.

            Hell even the structure/outline it took might not be correct.