OpenGPT-X in Graphene
Aim is to on-board the model into the Graphene platform such that it can be combined with other LLM pipelines.
- Got access to a server with one of the modal. A .sh script to run the model and get the inference is possible through ssh port forwarding
- Steps TBD to bring the model into the platform.
Edited by Sangamithra Panneer Selvam