Finding a target probability distribution for LLM confidence metrics:
Finding a target probability distribution for LLM confidence metrics:: a task in Task Alignment Bench (TAB) (Harbor dataset). Create a Python script that implements the following: 1. Find a probability distribution with the following exact properties: - forward KL divergence KL(P U) is 10.0 -…
The task
Create a Python script that implements the following: 1. Find a probability distribution with the following exact properties: - forward KL divergence KL(P||U) is 10.0 - backward KL divergence KL(U||P) is 10.0 - the tolerance for both KL divergences is 0.001 (i.e., |KL - 10.0| ≤ 0.001) 2. Save the results in the exact…
Part of anonymous98570239854/tab.