Azure OpenAI

opsverse's kubernetes agent https //docs opsverse io/install the opsverse agent#veqxm can collect metrics from azure openai add the following yaml snippets to the agent's values yaml and run the agent based on these instructions https //docs opsverse io/install the opsverse agent#veqxm replace the placeholders \<azure client id>, \<azure tenant id>, \<azure client secret> in the following yaml with the appropriate values azure metrics exporter enabled true env debug "true" verbose "true" azure client id "\<azure client id>" azure tenant id "\<azure tenant id>" azure client secret "\<azure client secret>" the below job snippet must be added under extrascrapeconfigs of victoria metrics agent confing in the agent replace the placeholders \<azure subscription id> in the following yaml with the appropriate values victoria metrics agent extrascrapeconfigs \ job name az openai metrics scrape interval 30s metrics path /probe/metrics/list params name \ az openai template \ '{name} {metric}' subscription \ \<azure subscription id> resourcetype \ microsoft cognitiveservices/accounts metric \ raisystemevent \ raitotalrequests \ raiharmfulrequests \ rairejectedrequests \ successrate \ totalerrors \ totalcalls \ successfulcalls \ servererrors \ ratelimit \ dataout \ datain \ clienterrors \ blockedcalls \ processedprompttokens \ tokentransaction \ generatedtokens \ azureopenairequests \ azureopenaicontexttokenscachematchrate \ azureopenaitimetoresponse \ activetokens \ finetunedtraininghours \ latency \ raiabusiveusercount \ azureopenaiprovisionedmanagedutilization \ azureopenaiprovisionedmanagedutilizationv2 validatedimensions \ 'true' static configs \ targets \ http //devopsnow agent azure metr devopsnow\ svc cluster local 8080