The core of Lamucal's functionality lies in its ability to dissect and analyze various components of music. The platform employs several transformer models, each addressing different aspects of music analysis. These models include U-Net for audio source separation, Pitch-Net for pitch tracking, Beat-Net for beat detection, Chord-Net for chord identification, and Segment-Net for identifying music structure. By establishing correlations between frequency and time, these models work together to influence each other and provide a holistic view of the musical piece.
One of the key features of Lamucal is its capability to detect and identify musical chords. It supports a wide range of chord types including major, minor, seventh chords, and more complex variations like maj7, min7, sus2, sus4, and inverted chords. This feature is particularly beneficial for musicians looking to understand or recreate the harmonic structure of a song.
Lamucal also excels in beat detection and tempo tracking. Its Beat-Net model analyzes spectrograms of drums, bass, and other instruments to accurately determine the beats per minute (BPM) and downbeat positions in a track. This functionality aids producers in aligning their compositions with precise rhythmic structures.
For vocal tracks, Lamucal provides pitch tracking capabilities through its Pitch-Net model. This feature allows users to follow the melody line within vocal performances, which is crucial for tasks such as pitch correction or melody extraction.
The platform goes beyond basic analysis by offering insights into music structure. It identifies segment boundaries and labels sections such as intro, verse, chorus, and bridge. This structural analysis helps users understand the composition's layout and can be instrumental in remixing or rearranging songs.
Lyrics recognition is another significant aspect of Lamucal. The platform uses automatic speech recognition (ASR) technology to transcribe lyrics from vocal tracks. It supports multiple languages including English, Spanish, Portuguese, Russian, Japanese, Korean, Arabic, Chinese, among others. Additionally, it aligns these lyrics with the corresponding audio segments using fine-tuned models.
Lamucal also offers AI Tabs functionality that generates playable sheet music. This feature includes chord charts and six-line staves based on the analyzed chords, beats, music structure information, lyrics, and rhythm. Users can edit these elements to suit their specific needs.
Key features of Lamucal include:
Lamucal aims to provide a comprehensive toolkit for anyone involved in music production or analysis by combining AI-driven insights with user-friendly features that enhance creativity and understanding of musical compositions.