I'm a biology postdoc, learning a new data analysis method for whole genome sequencing (WGS), a new area in my skillset. First, I had a consultation with a bioinformatician, and did extensive background reading of relevant github manuals and publications. Based on the information I had gathered, I designed an analysis, using a gemini agent designed by the bioinformatics department, and launched it on the university's SGE (cloud compute platform). In trying to get the ambitious workflow to run, I utilized ChatGPT 5.4 (thinking mode).
For a while, I seemed to be making progress in isolating the problem. I sent ChatGPT the initial set of error logs, it found the error that broke the code, and suggested some modifications. I applied the modification, re ran the code, supplied new error logs. This process had repeated 4-5 times, before I realized I was going in circles. Every time an error was "resolved", a problem popped up downstream. Then, when I fixed a downstream problem, the earlier "fix" was incompatible with it.
At that point, I asked ChatGPT if it was considering the entirety of the error log, in the context of my workflow. To my astonishment, it replied "no". According to ChatGPT, it had been scanning the error logs, and stopping at the first error it found. Its suggested modification concerned that error alone, with little consideration for how this modification affects the rest of the process. I tried again several times, on a new day, but eventually set this aside.
While experienced programmers have gotten similar analyses to run, I was stuck. I know the problem (dependencies), but have no solution.
I have successfully debugged other complex workflows using ChatGPT in the past. I had designed those analyses from scratch, based on an original approach. Though complex and multi-faceted, my analyses are much simpler compared to programs made by experienced programmers. My current failure was attempting to debug what is essentially a black box for me. In order to use ChatGPT for this purpose, I need to guide it, or at least have sufficient knowledge to catch it when it starts going in circles.
I hope I didn't provide too much detail regarding coding in this ChatGPT subreddit. The purpose of the post is to share my insight regarding the the utilization of ChatGPT for coding at a skill level appropriate for the user. For my current analysis, I have adopted a more manageable approach, which is working fine. The ChatGPT-assisted debugging there has been useful.