## A.I. Duet with Music Transformer
A piano that responds to you.
![](./assets/AI_duet_with_Onset_and_Frames_and_Transformer_model.gif)
### Contributers: ![Asiya Lazareva ](https://github.com/alazareva), ![ruiguo-bio](https://github.com/ruiguo-bio) and ![Mrityunjay](https://github.com/MrityunjayBhardwaj)
## About
This is the port of ai-duet experiment by google: https://github.com/googlecreativelab/aiexperiments-ai-duet where, instead of using performanceRNN we are using ![Music Transformer](https://magenta.tensorflow.org/music-transformer)
> DISCLAIMER: This code is **super experimental**. please run it with a big grain of salt.
## CREDITS from original repo
The original ai-duet experiment was Built by [Yotam Mann](https://github.com/tambien) with friends on the Magenta and Creative Lab teams at Google. It uses [TensorFlow](https://tensorflow.org), [Tone.js](https://github.com/Tonejs/Tone.js) and open-source tools from the [Magenta](https://magenta.tensorflow.org/) project. Check out more at [A.I. Experiments](https://aiexperiments.withgoogle.com).
## INSTALLATION
* Clone this repo in your desired folder
```bash
git clone https://github.com/MrityunjayBhardwaj/aiDuet-with-Music-Transformer.git
```
* Create and activating a virtual environment ( or use the existing one if you are feeling adventurous :P )
if you are using conda then you can simply run this command :-
```bash
conda create --name myenv python=3.7.7
```
this will create a new virtual environment called myenv with python=3.7.7 preinstalled
after that, you can activate this virtual environment by simply running this command:
```bash
conda activate myenv
```
* for installing the rest of the dependencies :- simply go to the sever folder and install all the dependencies from requirements.txt
```bash
cd server
pip install -r requirements.txt
```
* the checkpoints for music Transformer can be found here:-
```bash
gsutil -q -m cp -r gs://magentadata/models/music_transformer/primers/* ./assets/checkpoints
```
also, soundFont can be fetched using "gsutil" as well:
```bash
gsutil -q -m cp gs://magentadata/soundfonts/Yamaha-C5-Salamander-JNv5.1.sf2 ./assets/soundFonts
```
* Then, to build and install the front-end Javascript code, first make sure you have [Node.js](https://nodejs.org) 6 installed. And then install of the dependencies of the project and build the code by typing the following in the terminal:
```bash
cd static
npm install
npm run build
```
Finally, to run this webapp simply type ( and hope for the best):
```bash
python server.py
```
You can then play with A.I. Duet at [localhost:8080](http://localhost:8080).
## MIDI SUPPORT
The A.I. Duet supports MIDI keyboard input using [Web Midi API](https://webaudio.github.io/web-midi-api/) and the [WebMIDI](https://github.com/cotejp/webmidi) library.
## PIANO KEYBOARD
The piano can also be controlled from your computer keyboard thanks to [Audiokeys](https://github.com/kylestetz/AudioKeys). The center row of the keyboard is the white keys.
## AUDIO SAMPLES
Multisampled piano from [Salamander Grand Piano V3](https://archive.org/details/SalamanderGrandPianoV3) by Alexander Holm ([Creative Commons Attribution 3.0](https://creativecommons.org/licenses/by/3.0/)).
String sounds from [MIDI.js Soundfonts](https://github.com/gleitz/midi-js-soundfonts) generated from [FluidR3_GM.sf2](http://www.musescore.org/download/fluid-soundfont.tar.gz) ([Creative Commons Attribution 3.0](https://creativecommons.org/licenses/by/3.0/)).
## LICENSE from the original repo
Copyright 2016 Google Inc.
s
Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
没有合适的资源?快使用搜索试试~ 我知道了~
使用Music Transformer 进行 AI Duet 实验_JavaScript_代码_下载
共131个文件
mp3:60个
js:29个
mid:7个
1.该资源内容由用户上传,如若侵权请联系客服进行举报
2.虚拟产品一经售出概不退款(资源遇到问题,请及时私信上传者)
2.虚拟产品一经售出概不退款(资源遇到问题,请及时私信上传者)
版权申诉
0 下载量 50 浏览量
2022-06-16
21:27:49
上传
评论
收藏 2.95MB ZIP 举报
温馨提示
使用 Music Transformer 进行 AI Duet 实验 效果如图所示: https://github.com/MrityunjayBhardwaj/aiDuet-with-Music-Transformer/raw/master/assets/AI_duet_with_Onset_and_Frames_and_Transformer_model.gif
资源推荐
资源详情
资源评论
收起资源包目录
使用Music Transformer 进行 AI Duet 实验_JavaScript_代码_下载
(131个子文件)
splash.css 9KB
about.css 3KB
keyboard.css 1KB
main.css 937B
tutorial.css 557B
glow.css 469B
notsupported.css 308B
AI_duet_with_Onset_and_Frames_and_Transformer_model.gif 613KB
robot.gif 5KB
.gitignore 131B
index.html 906B
magenta112.js 3.13MB
audiokeys.js 34KB
Main.js 7KB
audioSplash.js 5KB
Element.js 5KB
About.js 4KB
Roll.js 4KB
Keyboard.js 4KB
Splash.js 4KB
AI.js 3KB
Tutorial.js 3KB
Sampler.js 2KB
fileSaver.js 2KB
Sound.js 2KB
Modernizr.js 2KB
Loader.js 2KB
audioLoader.js 2KB
Glow.js 2KB
webpack.config.js 2KB
Midi.js 2KB
RollNote.js 2KB
finalSplash.js 1KB
AIRaw.js 1KB
FeatureTest.js 1KB
Note.js 1KB
audioFileInput.js 1KB
micInput.js 631B
saveGenMusic.js 604B
retry.js 600B
package.json 1KB
README.md 4KB
unconditional.mid 4KB
prelude_in_c_major.mid 153B
moonlight_sonata.mid 147B
clair_de_lune.mid 146B
fur_elise.mid 131B
c_major_scale.mid 107B
c_major_arpeggio.mid 105B
Ds1.mp3 118KB
A1.mp3 112KB
Fs1.mp3 112KB
A0.mp3 111KB
Ds2.mp3 108KB
C2.mp3 108KB
C1.mp3 108KB
Fs2.mp3 100KB
A2.mp3 80KB
C4.mp3 77KB
Ds3.mp3 77KB
C3.mp3 76KB
Fs3.mp3 76KB
A3.mp3 73KB
Ds4.mp3 72KB
C5.mp3 67KB
Fs4.mp3 67KB
A4.mp3 60KB
Ds5.mp3 57KB
Fs5.mp3 50KB
A5.mp3 45KB
Ds6.mp3 31KB
A6.mp3 29KB
C6.mp3 27KB
Fs6.mp3 26KB
Fs7.mp3 22KB
Ds7.mp3 22KB
C7.mp3 19KB
C8.mp3 18KB
A7.mp3 18KB
C1.mp3 10KB
Fs4.mp3 10KB
Fs6.mp3 10KB
Fs5.mp3 10KB
C4.mp3 10KB
C6.mp3 10KB
A1.mp3 10KB
A0.mp3 10KB
Fs2.mp3 10KB
C5.mp3 10KB
A2.mp3 10KB
A6.mp3 10KB
A7.mp3 10KB
Ds1.mp3 10KB
Fs1.mp3 10KB
Ds7.mp3 10KB
C3.mp3 10KB
C2.mp3 10KB
A4.mp3 10KB
Fs3.mp3 10KB
Ds3.mp3 10KB
共 131 条
- 1
- 2
资源评论
快撑死的鱼
- 粉丝: 1w+
- 资源: 9154
上传资源 快速赚钱
- 我的内容管理 展开
- 我的资源 快来上传第一个资源
- 我的收益 登录查看自己的收益
- 我的积分 登录查看自己的积分
- 我的C币 登录后查看C币余额
- 我的收藏
- 我的下载
- 下载帮助
安全验证
文档复制为VIP权益,开通VIP直接复制
信息提交成功