Open Source Projects: Hyena Hierarchy, Griptape, and TruthGPT
Hyena Hierarchy is a new subquadratic-time layer in AI that combines long convolutions and gating, reducing compute requirements significantly. This technology has the potential to increase context length in sequence models, making them faster and more efficient. It could pave the way for revolutionary models like GPT4 that could run much faster and use 100x less compute, leading to exponential improvements in speed and performance. Check out Hyena on GitHub for more information.
Elon Musk has been building his own AI called TruthGPT, which he calls a "maximum truth-seeking AI that tries to understand the nature of the universe." This comes after his recent call for a pause on AI advancements because he feared that Google/DeepMind were winning and would lead to unsafe AGI. Musk has faced criticism for his ethical stance on AI, particularly given the controversial neural interface project he pursued, which resulted in dozens of lab monkeys being killed. Nonetheless, his projects are making waves in the AI industry.
A new open-source project called Griptape is an alternative to LangChain with execution environments for tools like Docker, Lambda, etc. Former AWS engineers are working on it, and it has an adapter that generates a ChatGPT plugin API. Check out the Griptape GitHub repository or this Reddit post for more details.
The AI industry is advancing rapidly, with powerful new tools like LLaVa and ChatGPT that can generate images and text with unprecedented speed and accuracy. However, there are concerns about the impact of AI on the job market and the ethics of some AI projects. Despite these issues, the development of AI continues to be one of the most exciting and transformative technological advances of our time.
Thanks for reading this summary of recent AI developments. We hope you find it helpful!