ianb/infinite-ai-array
View on GitHub ↗ ★ 167 Python
Do you worry that you'll get to the end of a good list and have nothing more, leaving you sad and starved of data? Worry no more!
6 mentions on Hacker News by 5 people: 2 stories, 4 comments · first 2023-01-03 · latest 2023-01-14
20082026
-
Yes... and no. There's a slightly horrifying piece of introspection code that does this: https://github.com/ianb/infinite-ai-array/blob/main/iaia/ins...
comment by vore · 2023-01-04 · in Infinite AI Array -
It is also caching requests on-disk. See for instance https://github.com/ianb/infinite-ai-array/blob/main/iaia/gpt... The problem* is that if a prompt changes slightly then it won't be a cache hit. * okay, one problem.
comment by wging · 2023-01-03 · in Infinite AI Array -
…code shows that it's using pickling to store OpenAI responses on the local filesystem. See here: https://github.com/ianb/infinite-ai-array/blob/main/iaia/gpt... and here: https://github.com/ianb/infinite-ai-array/blob/main/iaia/gpt...
comment by wging · 2023-01-03 · in Infinite AI Array -
I'm no python expert but it looks like this does happen in memory: https://github.com/ianb/infinite-ai-array/blob/main/iaia/mag... I can't imagine it's too hard to serialize the `existing` python dict so subsequent runs are deterministic
comment by keuriGPT · 2023-01-03 · in Infinite AI Array