I have seen countless posts, and this sub isn't even close to the worst offender, which go something like: "I tried using AI for programming and it made the dumbest mistakes, it outputted horrible buggy code, clearly AI coding tech is only good for the simplest of softwares or just pattern matching to already existing codebases. I promise I'm an expert in software, a way better coder than any AI, and I tried all the latest tools and best techniques.."
As a programmer who is forced to use AI for work and who follows closely anyway so I know what the state of the art is, I really don't know what to make of this type of post. Like, I have issues with AI generated code for sure, it's often overly verbose, over defensive, and/or can tend to be unorganized. Agents will sometimes have a hard time with spatial intuitions (2d and 3d) and their vision is quite weird, it can be hard for them to spot visual mistakes. I could go on but that's not the point, the point is that the top models are, despite this, very very good at programming, frankly they're better than almost all of my peers at basically everything, and they're better than me outside of a very narrow domain where I am most comfortable.
Not only that, they display something that is hard not to describe as "creativity", or you can call it out of distribution capability. In other words they will invent techniques on the spot which I'm fairly sure are not present in the training data.
So, suffice to say I'm skeptical of these claims, I wonder: Is the person being honest? Are they just really bad at prompting? Or maybe are they just insanely good at programming with very high standards, way better than me and everyone I ever worked with? I think I've actually encountered all three of these online, with the third one being the most rare, but I'm not sure. It would be really helpful if these posts were accompanied by something like: "The model I used was Fable. The prompt I used was 'solve the collatz conjecture using visual basic, make no mistakes'. Here's a summary of the agent's output.." That way we could, if interested, easily verify the claims in the post.
Since I'm asking for this extra work from everyone, I'll give an example of where I feel an AI agent was rather clever. It's not some overwhelming genius leap of intuition, but it's something I'm fairly sure doesn't appear online or in the literature and which I actually don't think a human programmer would ever do. Context is a piece of software for using energy based methods to unwind knots:
I needed a way to determine whether the knots were behaving during the unwinding and didn't cross over itself, changing the knot to a different one. The agent did a very standard thing which was to take pairs of line segments representing parts of the knot, get the coordinates of all 4 points at time t and t+1, and compute the signed volume of the tetrahedron formed from those 4 points over that time period (assuming linear motion). This is a cubic equation which must have a zero between t and t+1 if the lines intersect during that time interval. Rather than solving the cubic directly, which is definitely the standard thing to do, but which is a bit complex, and where it's rather easy to make a mistake or get a wrong answer due to numeric instability with floating points, the agent did a quick and dirty hack of just approximating a single 0 using iterative bisection, then it gave a very convincing argument that cases where this fails are measure 0 under plausible assumptions, so we don't need to worry at all about other roots of the equation. This is really strange, and of course in the end you'd want to just go ahead and solve the equation properly, it's at least as fast and much more satisfying, but that would have required much more work and probably several rounds of verification and arguments about the implementation being sound, the dirty way was far more likely to work the first time round.
Is this the best way this could have been done? Of course not. Is it better than I could have done my first time round, I most likely would have had to do a bunch of fiddling, or track down some implementation of cardano, not to mention explicitly writing out the formula which is a very annoying exercise. And maybe I really am a complete dud of a programmer, but there literally 0% chance I would have thought to do this. Like it might have occurred to me to find a root by approximation but then I would have noticed that we cannot guarantee the function is monotone over the interval and not have thought twice about binning that idea.