I have made some Python code which integrates the new Turbo 3.5 API from OpenAI.
The code reads in a document with approx. 6000 characters, but as ChatGTP can only handle around 2000 characters at a time, the code splits up the code into chunks of 2000 characters which are then sent to the API. (see screenshot)
This ‘chunking’ works very well. Before I used a library to summarize the content from 6000 words to 2000. However, I felt too much information was being lost as only 1/3rd of the original characters were left - hence ‘chunking’.
However, the advantage of the summarization approach was that I could prompt the API to list me the 10 main points of the content as the API only had do its processing of the prompt 1 time.
Now if I do this, it will give me 10 main points of ‘Chunk 1’, 10 main points of ‘Chunk 2’ and so forth.
My question is, any ideas how I can have all the output summarized into a list of 10 points. I know I can just copy/paste it into the ChatGTP web-interface, but that defeats the purpose of using automation.
I hope I was more or less able to explain my scenario.
Thanks in advance for all responses.