Probability Distribution Normalization and Entropy Calculation
Probability Distribution Normalization and Entropy Calculation: a task in Nemotron Terminal easy clean-1K: rootless Apptainer release (Harbor dataset). You are working with discrete probability distributions in a scientific data processing pipeline. Your task is to read a probability distribution…
The task
You are working with discrete probability distributions in a scientific data processing pipeline. Your task is to read a probability distribution from a JSON file, validate and normalize it, then compute its Shannon entropy.
Part of laion/nemotron-terminal-easy-clean1k-rootless-apptainer.