Converting images to KiCAD schematics using GPT4

I thought if there was a way to convert screenshots from datasheets to KiCAD schematics that could save so much time! As I googled it seems there have been many attempts in the past to do so using a computer vision pipeline that hasn’t seen much success. But in 2024, with all the generative AI tools I thought it would be worth a try to look at this problem from a fresh perspective!

As of now the script works with simple circuits consisting of resistors, LEDs, capacitors, inductors and batteries. However, one challenge I don’t seem to wrap my head around is auto-placement of symbol fields. Is there any way to prompt KiCAD to autoplace fields like value, reference etc by making changes in the raw .kicad_sch file?

I’m super excited about this project and appreciate any feedback/suggestions on the same!