Updated 119 days ago

OneClickLLM: Deploy LLM Inference APIs within Seconds on Akash Network

Our vision is to establish Akash Network as the premier platform for any Large Language Model (LLM) deployments. We aim to create a component that could integrate into Cloudmos/ the Akash Console or be a standalone platform, enabling users to deploy LLM inference APIs swiftly and effortlessly. Our goal is to make this technology accessible to everyone, including those with limited knowledge of Docker, containers, or SDL configuration, or people who wanna save a lot of time. We envision a user-friendly interface where individuals can select the LLM model they wish to deploy and receive a fully configured SDL file with a pre-set inference server. Additionally, our API is designed to be compatible with the OpenAI library, offering a seamless, open-source alternative. Ultimately, we want to make AI models accessible to everyone.

  • Crypto / Web3
  • Infra / API
  • akash
  • akash network
Members 1
Team info →
github.com/HoomanHQ/akash-hack2.0
qi8ibcto29blf3gld2192jtnk4.ingress.tekti.net
youtu.be/RGanol7kOt4
@hooman_digital

We have developed a platform that simplifies the deployment of LLM APIs on the Akash Network. Users can:

  1. Select their preferred model from the Huggingface or Ollama registry.
  2. Click "Deploy" to generate a properly configured SDL file with the inference API of the chosen model.
  3. Copy the SDL file and use it to deploy on Cloudmos or the Akash Console.

There is no need to push anything to Docker Hub or containerize any components; our tool handles everything automatically, ensuring an efficient and user-friendly experience.

We have also provided comprehensive documentation on the endpoints to make the platform accessible and appealing to new AI enthusiasts, thereby boosting the Akash Network.

Deploy Open Source Models Within Seconds on the Akash Network:

  1. Streamlined Deployment: Effortlessly deploy LLM APIs on the Akash Network.
  2. Ease of Use: Select your preferred LLM model, and receive a pre-configured SDL file for the inference server.
  3. Simple Process: Use the SDL file to deploy the LLM API on the Akash Network with just a few clicks on Cloudmos or the Akash Console.
  4. Fully Automated: The deployment process is fully automated, ensuring high availability, scalability, and security for the service.