Algorithm Challenge

What is it

The Algorithm Challenge is a competition to advance methods that reconstruct motor unit spike trains from high-density surface EMG (HDsEMG). It consists of two independent tasks and two sequential phases.

To participate, register on Codabench then navigate to the Algorithm challenge page!

Tasks

Competitors may participate in one or both tasks:

• Isometric task. Well-studied, stationary conditions for which multiple neural source separation methods currently exist.
• Dynamic task. Less studied, non-stationary conditions in which algorithmic performance remains limited, motivating the development of novel approaches and interactive exchange of ideas.

Each task yields an independent leaderboard.

Phases

Familiarization Phase

Running in parallel with the Data Challenge, algorithm developers are provided with training data from the MUniverse benchmark collection (including labels), allowing teams to build, test, and optimize their methods for both tasks.

• Participants can compete in both tasks or in only one task
• Competitors upload their predictions (motor unit spike trains) through the algorithm submission portal (coming soon)
• A preliminary leaderboard is provided as feedback
• Results from baseline algorithms (together with tutorials — coming soon) are provided for reference
• Participation in the Familiarization phase is encouraged by the organizers

Showdown Phase

The main algorithm competition, conducted using the MUnitQuest data collection established during the Data Challenge (labels hidden from competitors). Note that the organizers may make small alterations to the test data (e.g., injected noise, cropping signals) to limit the advantage of teams also participating in the Data Challenge.

• Submission of predicted motor unit spike trains for each recording
• To be eligible for awards, competitors need to share their code openly (e.g., using GitHub); submissions based on proprietary code are not eligible for awards
• The final leaderboards for the Isometric and Dynamic tasks will be based solely on performance during the Showdown Phase and will be publicly released

See the Submission and Registration page for details on how to submit predictions.

Leaderboard scoring

The scoring system for both tasks will be announced soon.

Awards

All teams receive recognition on a permanent leaderboard (per task). The top 5 teams per task (Isometric and Dynamic) will be invited to share their solutions in a special issue of the Journal of Electromyography and Kinesiology. All winning teams will also be invited to share their work in a collaborative benchmarking paper in the same special issue!