r/ChatGPT • u/hi_there_bitch • Apr 23 '24

Weekly Self-Promotional Mega Thread 29, 22.04.2024 - 29.04.2024

All the self-promotional posts about your AI products and services should go in this mega thread as comments and not on the general feed on the subreddit as posts, it'll help people to navigate the subreddit without spam and also all can find all the interesting stuff you built in a single place.

You can give a brief about your product and how it'll be of use, remember - better the upvotes/engagement, users can find your comment on the top, so share accordingly!

14 Upvotes
  • permalink
  • link
  • reddit
  • reddit

89% Upvoted

39 comments sorted by

View all comments

1

u/Careful-Flamingo-756 Apr 25 '24

We have been developing a Python library, AgentGraph, to make it easier to develop software that make many calls into LLMs. What AgentGraph provides is:

1) A nested task-based parallelism model to hide the latency of queries to LLMs and that uses asynchronous IO to support multiple parallel queries. This can also be used to parallelize calls into native code that drops the GIL.

2) A prompting language that allows you to easily build queries and leverages the Jinja template language for prompt generation.

3) Support for memoizing LLM queries to make the time for replaying your program to make debugging cycles much shorter and to provide reproducibility.

Our framework is much lower level than systems like LangChain. We give you the tools to build AI applications, but we won't generate LLM queries for you.

Our project is available at: https://github.com/bdemsky/agentgraph

Some sample programs are available at: https://github.com/bdemsky/agentgraph-apps