FineEnvs/data-agent-harbor-eval
data-agent-harbor-eval: Harbor dataset on Hugging Face with 144 tasks. A small, difficulty-balanced validation split — 144 tasks — perfect for quick checkpoints while you train. Same idea as the rest of the family: your agent gets a real dataset and a question, explores and answers, and everything…
Tasks
- How many times did Balon/Euron Greyjoy defeat Robb Stark in the dataset?
- What numerical value was assigned to the 'no employees' category 'More than 1000' during preprocessing?
- How many columns are present in the dataset after removing the 'Timestamp' column?
- What is the correlation coefficient between Air Temperature and Sea Surface Temperature in the dataset?
- What is the total number of rows in the dataset after using the pd.melt() function to transform the data for the swarmplot visualization?
- What is the number of unique statistical categories (e.g., HP, Attack, Defense, etc.) included in the transformed dataset used for the…
- Which publisher is associated with the most games in the dataset?
- What is the most common weapon used in unsolved homicides in the dataset?
- What is the accuracy of a model that predicts all transactions as non-fraudulent in this dataset?
- What percentage of the transactions in the dataset are classified as non-fraudulent?
- What is the most common cause of tsunamis in the dataset when excluding 'Unknown' and 'Questionable Earthquake' classifications?
- How many individuals from India have been selected as Person of the Year in the dataset?
- Which game has the highest total cumulative playing time in hours across all users?
- What is the average number of games played per user in the dataset?
- What percentage of all games played that exceed 1,000 hours are dedicated to Dota 2?
- How many users have played at least one game in the dataset?
- How many spam messages in the dataset contain phone numbers with four or more digits?
- What is the most frequent category in the 'Type' column of the dataset?
- What is the total number of samples across all glass types in the dataset?
- How many Pokémon in the dataset are classified as dual-type (have a non-null Type 2)?
- Which state has the highest total number of homicide crimes recorded in the dataset?
- Which ride purpose has the highest average miles driven per ride in the dataset?
- Which country has the highest number of top 100 female marathon runners in the dataset?
- What is the total number of miles driven by the Uber driver according to the dataset, as indicated in the "Totals" row before it was…
- Which team has the highest number of games played as the blue team in the dataset?
- What is the most frequently occurring activity class in the training dataset based on the distribution visualization?
- How many channels are present in each image pair in the dataset?
- What is the average spam score across all entries in the dataset?
- What is the average number of comments per entry in the dataset?
- What is the average duration of games in which SKT T1 participated?
- What is the average word count difference between spam and ham messages?
- What is the proportion of edible mushrooms (class 0) in the dataset compared to the total number of mushrooms?
- Which crime type is most frequently associated with the "Invest Cont" status in the dataset?
- What is the median trip duration in seconds after removing the top 0.5% of outlier durations?
- What is the total number of unique days represented in the dataset?
- Which day of the week has the lowest number of traffic-related 911 calls according to the analysis?
- Which political party secured the highest total number of votes in the UP election based on the dataset analysis?
- What is the most common reason cited for negative tweets in the dataset?
- Which airline received the highest number of neutral sentiment tweets in the dataset?
- What is the most common sentiment category in the dataset based on tweet distribution?
- What is the strongest negative correlation with the Happiness Score in the 2015 dataset?
- What is the maximum number of times a single player was considered for Hall of Fame induction across all years?
- What is the average number of awards received by players who received any awards in the dataset?
- What is the most frequent cap surface type in the original dataset before encoding?
- What is the most common cap color category in the original dataset before encoding?
- Which constituency (ac) had the highest total votes secured by BJP+ candidates?
- What percentage of transactions in the dataset are classified as fraudulent?
- What is the maximum transaction amount recorded in the dataset?
- What is the total number of features removed during the classification process?
- What is the difference between the highest and lowest number of votes received by any BJP+ candidate?
- How many candidates were affiliated with the "others" category?
- What is the total number of candidates from the "INC" party?
- Which football club has the highest average Overall rating among its players in the dataset?
- What is the total number of patients in the training dataset after merging with patient cancer labels?
- What is the total duration of the training data (train cat and train dog) in seconds?
- What percentage of tweets were identified as English by langid?
- Which topic shows the largest absolute difference in student count between the highest (H) and lowest (L) performance categories from the…
- Which year had the highest combined total of injured and fatality victims from mass shootings according to the grouped analysis?
- What was the highest number of fatalities recorded in a single year according to the mass shooting dataset?
- Which expenditure category shows the highest correlation with Total Household Income based on the correlation matrix analysis?
- Which movie genre generates the highest profit (calculated as mean revenue minus mean budget) in the dataset?
- Which batsman has the highest average runs per game among players who have participated in more than 10 matches?
- What is the highest average cereal rating among all manufacturers?
- What is the expected count of cereals for manufacturer A on shelf1 based on the calculated expected values for the contingency table?
- Which division has the lowest average number of completed challenges according to the dataset analysis?
- How many distinct time series in the dataset are explicitly related to wheat production in Germany?
- Which column prefix has the highest mean response rate in the dataset?
- What is the slope of the linear regression model predicting Petal Length from Sepal Length for the Iris-virginica species in the dataset?
- Which release year had the highest number of movies with missing homepage information?
- What is the standard deviation of the 'Age' feature in the dataset after all preprocessing steps but before applying Min-Max Scaling?
- What is the average monetary value of an order based on the dataset?
- Which word in the training set has the highest total occurrence count according to the feature frequency analysis?
- Which cereal has the highest potassium content among those with the top 5% health ratings?
- How many unique actors or actresses have played themselves (as "Himself" or "Herself") in the dataset?
- What is the Pearson correlation coefficient between the number of tweets and total retweets for all organizations in the dataset?
- What is the average number of rainy days per year in Seattle from the year 2000 to 2017?
- Which neighborhood has the highest average number of crimes per year in Vancouver?
- Which country has the highest average wine price based on the dataset analysis?
- What continent showed the highest percentage contribution to New Zealand citizen departures in the year 2016?
- After merging similar job categories, which job category has the highest number of clients in the dataset?
- Which state has the highest total population when data is aggregated by state?
- Which feature has the highest importance in the Decision Tree classifier model for distinguishing between running and walking activities?
- Which method for handling missing data resulted in the lowest mean absolute error (MAE) in the linear regression model?
- How many properties had a sale price below $100,000 after removing duplicates and handling missing values?
- How many features were used in the Linear Regression model after preprocessing the data?
- How many races in the dataset had multiple jockey falling incidents (i.e., two or more falls in a single race)?
- What is the highest correlation coefficient found between any two variables in the anime dataset?
- What is the most preferred genre among the top-rated animes for a randomly selected user?
- What is the mean squared error (MSE) of the linear regression model on the test data?
- Which feature was identified as having the highest individual impact on wine quality prediction based on the grid search's feature…
- Is there a statistically significant negative correlation between volatile acidity levels and wine quality classification as indicated by…
- How many stars were misclassified by the SVM model in the test set?
- What is the total number of stars in the test set based on the confusion matrix of the SVM model?
- What is the number of true negatives predicted by the SVM model on the test set?
- What percentage of the variance in miles per gallon (mpg) is explained by the regression model including cylinders, horsepower…
- Among the top five most reviewed Australian wine varieties, which variety has the highest number of wines rated above 93 points with a…
- What is the cross-validation accuracy of the logistic regression model using 10-fold cross-validation on the training data?
- What is the homogeneity score achieved by the hierarchical clustering method with 'centroid' linkage when it correctly identifies all 23…
- What is the top negative word contributing to negative sentiment predictions in the model?
- What is the R-squared value of the linear regression model fitted between pelvic incidence and sacral slope for abnormal cases?
- What is the p-value from the Kruskal-Wallis test assessing whether TED Talk events have statistically different distributions of view…
- Which preprocessing scaler (standard or minmax) achieves better F1 performance for the L2 logistic regression model on validation data?
- What is the most produced food item globally according to the dataset's 10-year analysis?
- What is the top food item produced in India based on total production in the dataset?
- When using the deterministic (stochastic=False) bigram generator with the starting word "Jesus", what specific phrase is produced?
- What is the cross-validation accuracy of the Logistic Regression model using the 'newton-cg' solver?
- What is the weighted F1 score achieved by the best model on the test set?
- What is the test set accuracy of the Decision Tree model with max depth=3?
- What was the test accuracy of the optimized SVM model after hyperparameter tuning using GridSearchCV?
- What is the predicted sacral slope value for a patient with a pelvic incidence of 110 using the decision tree regression model?
- Which pair of activities is most frequently misclassified by the models according to the t-SNE visualization analysis?
- What is the correlation coefficient between sentiment polarity scores of wine descriptions and wine points?
- Which regularization technique produced the lowest root mean squared error (RMSE) value in the wine quality prediction task?
- Which cluster shows the highest deviation in the variables "Medicine, Biology, Chemistry, and Gardening" from the dataset median?
- What is the accuracy of the K-Nearest Neighbors model without cross-validation?
- What is the specificity (true negative rate) of the model for predicting benign tumors in the test set?
- Is the correlation between Happiness.Rank and Happiness.Score statistically significant based on the correlation matrix?
- Which feature has the highest coefficient in the final regression model predicting world rank?
- What is the F1-score for predicting Team 1 wins in the classification report?
- What is the mean accuracy of the Random Forest classifier when evaluated using RepeatedStratifiedKFold cross-validation with 20 repeats?
- What is the most important feature for predicting job satisfaction according to the random forest model?
- Which classification model achieved the highest test accuracy among Logistic Regression, SVM, and Random Forest?
- Which model has the lowest precision score for class 1 (diabetic) in the test set evaluation?
- What is the average ROC AUC score achieved by the LightGBM model using 5-fold cross-validation after hyperparameter optimization?
- What is the average precision score of the LightGBM model using 5-fold cross-validation after hyperparameter optimization?
- How many principal components were determined to be optimal for face recognition in the Olivetti dataset based on variance analysis?
- What is the average precision score for the multi-label classification approach using Logistic Regression with OneVsRestClassifier?
- What is the highest accuracy achieved by any model when using petal features?
- Which feature has the highest importance in predicting whether a Pokémon is legendary according to the Random Forest model?
- Which feature from the mean measurements has the highest importance score according to the Random Forest classifier trained on all mean…
- How many categorical features demonstrate statistically significant associations with customer churn at the p < 0.05 level?
- Which variable exhibits the highest multicollinearity in the dataset as measured by the variance inflation factor (VIF)?
- Did applying z-score standardization instead of min-max normalization improve the model's error rate on the test set?
- Is the difference in mean Total Household Income between female-headed and male-headed households statistically significant at the 1%…
- What is the rank of 'international plan' among the top five most important features in the final model?
- Did the BaggingRegressor improve the test performance of the KNeighborsRegressor compared to the base estimator?
- In the SVM model's confusion matrix, how many Iris-virginica samples were misclassified?
- What is the F1-score for the minority class (diabetic patients) in the final KNN model evaluation?
- Which model (SVM, Logistic Regression, KNN, Decision Tree) achieved the highest accuracy when using sepal measurements as features?
- What is the classification accuracy of the Decision Tree model using sepal measurements as features?
- What is the best validation accuracy score achieved by the CatBoost model during cross-validation with 10 folds?
- Which student performance class (H/M/L) achieved the highest F1-score in the Random Forest model evaluation?
- What is the accuracy of the decision tree classifier on the test set when trained on the full dataset?
- What is the test accuracy of the TF-IDF model using Naive Bayes?