Skip to content

General User Diagonistics node

The aim of this issue is to create a general node to perform user diagnostics and to use this node commonly in different pipelines.

image

Tasks

  • Preparation of the node: Json Strategy - Node reads metrics, star rating and feedbacks from json file and calculates overall average score. ( work in progress )
  • Testing with GLLM and ReadMe pipelines
  • Testing with Rag pipeline

Updates

  1. User_Diagonistics.proto :

image

  1. Steps to follow for using General User_Diagonistics Node in your pipeline
  • The final container of the pipeline needs to write the data into a json file.
  • Metrics:
    • Filename : optional
    • Timestamp: optional
    • Ratings: optional
    • LLM_Metrics : optional -> accepts n number of metrics

Conclusion

It is a short, work in progress ticket and possibly will undergo changes in textual description and tasks if other strategies are explored.

Edited by Sangamithra Panneer Selvam