Thanks to the efforts of our partners and the support of investors, after half a year of work, the "Love Play" mini program has been updated!
The "Love Play" applet should be the most complete online piano playing evaluation applet that embodies artificial intelligence. "Love Play" can evaluate a piano piece played by the user with one click, complete a series of intelligent calculations such as key analysis, music identification, and alignment, and give a final evaluation. "Love Play" does not require users to play a track from beginning to end. It allows fragment playing and various errors, jumps and repetitions when unfamiliar with the track. Users do not need to select a song. They can simply press start and end the evaluation to complete the evaluation with one click. Our current primary goal is to build this small program into a tool application that can help piano beginners practice piano.
The main features of the new version are:
-
Detailed analysis report. Visually and dynamically display the performance of your playing on the staff, giving you possible locations where there may be problems with your playing. At the same time, the analysis report can be shared to Moments or WeChat friends;
-
Supports both audio and video input. Users can use audio (the mini program is limited to 10 minutes) for evaluation and analysis, or they can choose to shoot videos (the mini program itself is limited to one minute) or select videos from the album to upload (due to the lack of video compression process, uploading will take a certain amount of time);
-
Support smart speakers as input terminals. We DIYed a smart speaker to complete the evaluation operation, freeing up parents’ mobile phones so that children can conveniently conduct evaluations themselves;
Compared with the previous version, the improved functions mainly include:
-
Highly optimized search alignment algorithm. At present, the mini program mainly relies on intelligent music recognition to locate the track played by the user, and uses a better alignment algorithm to complete the alignment of keys and staff notes. Compared with the original version, the entire calculation process has improved the processing speed by more than an order of magnitude while improving the effect. Now our server can support more users at the same time;
-
The analysis program currently allows certain background sounds, including lower voices, etc. In particular, we currently support playing analysis under the "metronome" background sound, which is a very big improvement compared to the previous version;
-
Generation of digital staff scores and demonstration playing. Because there may be copyright issues involved, our demonstration performance does not use real people crawling from the Internet, but we don’t have the money to record it ourselves, so we can only use a program to read the digital staff and generate the demonstration performance. However, the problem this brings is that for complex music scores, the demonstration playing is not very accurate and reasonable, but it is still useful as a melody reference.
Introduction to usage(User information and authorization are required during use, please cooperate)
WeChat->Discover->Search for iPlay to discover our mini program.
Machine-translated from the Chinese original “爱弹奏”，一键评测钢琴弹奏的AI小程序 (published 2020-02-23). WeChat original ↗