General User Diagonistics node
The aim of this issue is to create a general node to perform user diagnostics and to use this node commonly in different pipelines.
Tasks
-
Preparation of the node: Json Strategy - Node reads metrics, star rating and feedbacks from json file and calculates overall average score. ( work in progress ) -
Testing with GLLM and ReadMe pipelines -
Testing with Rag pipeline
Updates
- User_Diagonistics.proto :
- Steps to follow for using General User_Diagonistics Node in your pipeline
- The final container of the pipeline needs to write the data into a json file.
- Metrics:
- Filename : optional
- Timestamp: optional
- Ratings: optional
- LLM_Metrics : optional -> accepts n number of metrics
Conclusion
It is a short, work in progress ticket and possibly will undergo changes in textual description and tasks if other strategies are explored.
Edited by Sangamithra Panneer Selvam