使用机器学习检测唱名手势_python_JavaScript_代码_下载

# solfege.ai ✋ 🎹 Detect solfege hand signs using machine learning ([live demo](https://solfege.ai)) > a project by [Ryan Kemmer](https://github.com/ryankemmer) and [Josh Stovall](https://joshstovall.com) ## About We have developed a system that allows the user to 'play' [solfege hand signs](https://en.wikipedia.org/wiki/Solfege) as a MIDI instrument. This technology could have practical applications both in music education and creation. Solfege hand signs are often used in school choirs to teach music theory concepts. Since vocalists cannot actually see the notes on their instrument, hand signs have been developed as a teaching aid. This system allows students to play the hand signs as an instrument -- recieving auditory feedback. Previously, a student learning solfege would have to sing the note or play another instrument to 'hear' their hand signs. ## Libraries This project uses [TensorFlow](https://github.com/tensorflow/tensorflow), [MediaPipe](https://google.github.io/mediapipe/solutions/hands.html), and [JZZ.js](https://github.com/jazz-soft/JZZ). ## Setup ``` cd solfege php -S 0.0.0.0:1234 ``` go to `http://localhost:1234` ## Use ### creating data sets * make a hand sign * click the button to create training data * it will wait 1 second, start recording data for 30 seconds, then save a file with the data ## Hand Signs | hand sign | name | pitch class <br>(distance from C) | equivalent note | | :-: | :-: |:-: |:-: | |<img src="https://github.com/instrumentbible/solfege/blob/main/img/do.png?raw=true" width="100" height="100" /> | do | 0 | C | |<img src="https://github.com/instrumentbible/solfege/blob/main/img/di.png?raw=true" width="100" height="100" /> | di | 1 | C# | |<img src="https://github.com/instrumentbible/solfege/blob/main/img/ra.png?raw=true" width="100" height="100" /> | ra | 1 | Db | |<img src="https://github.com/instrumentbible/solfege/blob/main/img/re.png?raw=true" width="100" height="100" /> | re | 2 | D | |<img src="https://github.com/instrumentbible/solfege/blob/main/img/ri.png?raw=true" width="100" height="100" /> | ri | 3 | D# | |<img src="https://github.com/instrumentbible/solfege/blob/main/img/me.png?raw=true" width="100" height="100" /> | me | 3 | Eb | |<img src="https://github.com/instrumentbible/solfege/blob/main/img/mi.png?raw=true" width="100" height="100" /> | mi | 4 | E | |<img src="https://github.com/instrumentbible/solfege/blob/main/img/fa.png?raw=true" width="100" height="100" /> | fa | 5 | F | |<img src="https://github.com/instrumentbible/solfege/blob/main/img/fi.png?raw=true" width="100" height="100" /> | fi | 6 | F# | |<img src="https://github.com/instrumentbible/solfege/blob/main/img/se.png?raw=true" width="100" height="100" /> | se | 6 | Gb | |<img src="https://github.com/instrumentbible/solfege/blob/main/img/so.png?raw=true" width="100" height="100" /> | so | 7 | G | |<img src="https://github.com/instrumentbible/solfege/blob/main/img/si.png?raw=true" width="100" height="100" /> | si | 8 | G# | |<img src="https://github.com/instrumentbible/solfege/blob/main/img/le.png?raw=true" width="100" height="100" /> | le | 8 | Ab | |<img src="https://github.com/instrumentbible/solfege/blob/main/img/la.png?raw=true" width="100" height="100" /> | la | 9 | A | |<img src="https://github.com/instrumentbible/solfege/blob/main/img/li.png?raw=true" width="100" height="100" /> | li | 10 | A# | |<img src="https://github.com/instrumentbible/solfege/blob/main/img/te.png?raw=true" width="100" height="100" /> | te | 10 | Bb | |<img src="https://github.com/instrumentbible/solfege/blob/main/img/ti.png?raw=true" width="100" height="100" /> | ti | 11 | B | # Contributing Any contributions you make are **greatly appreciated**. Any bugs and change requests are to be reported on the [issues tab](https://github.com/instrumentbible/instrument.bible/issues). If you don't like coding, you can contribute by becoming a sponsor. [](https://github.com/sponsors/instrumentbible) [](https://patreon.com/instrumentbible) [](https://checkout.square.site/pay/31ba92dcb17e4a9c979c022b690659bb) [](https://venmo.com/u/instrumentbible) [](https://paypal.me/instrumentbible) # Questions? Please write to [contact@instrument.bible](mailto:contact@instrument.bible) or visit [instrument.bible](https://instrument.bible). [](https://discord.gg/VJDj7nt) [](https://twitter.com/instrumentbible) [](https://youtube.com/channel/UCkw7klLsjYXYGzFT-9a3WMA) [](https://facebook.com/instrumentbible) [](https://linkedin.com/company/instrumentbible) [](https://instagram.com/instrument.bible)