Repository navigation
benchmarks/idmt-first-run - #321
Merged
Merged
Conversation
…enchmarking datasets in benchmarking/data/
bellescoincidences
requested review from
drumscript-admin and
victoria-mckinney
as code owners
September 11, 2026 13:40
Member
|
relates to #322 |
…enchmarks/README.md
… tree_benchmarks.txt
Member
|
Hi @nanaoto 👋 First end-to-end run of the IDMT benchmark using the adapter you contributed - it works! These are our first real, reproducible numbers. Sharing for your eyes before we go further. Setup
Results (F-measure)
By subset (kick recall is the story):
What jumps out
I'm adding an MDB-Drums adapter for breadth (crash/ride/tom coverage IDMT lacks) and also an ENST adapter. Im keen to expand the labelling/mappings to all the parts that DrumScript tries to classify; thus why I am moving beyond just using IDMT. I'm also keen to get as much data as possible to identify where the classification model needs to be improved. |
victoria-mckinney
approved these changes
Sep 14, 2026
…Script/DrumScript into benchmarking/idmt-first-run
Author
|
@nanaoto merging these changes to main for now. let me know if you get a chance to review |
bellescoincidences
changed the title
Author
|
Work continued on/related to #335 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Benchmarking datasets first run mir_eval