My personal test for 'do LLMs still suck at coding' is whether they can code a function to draw a pythagorean tree. They all draw a bunch of squares on a canvas, but get tripped up rotating the children correctly.

The green diagram is the best 'attempt' I got, from o1-preview. It's not an obscure concept, it should be in their training data... 🤔