Artificial Intelligence and Voice Modeling: Cutting-edge Technology in Music Production

Authors

  • Adrian BORZA University Professor Ph.D. Habil., “Gheorghe Dima” National Academy of Music, Cluj-Napoca, Romania. Email: adrian.borza@amgd.ro. Website: www.adrianborza.ro https://orcid.org/0000-0001-6744-566X

DOI:

https://doi.org/10.24193/subbmusica.2025.1.19

Keywords:

Artificial Intelligence, Text-to-Speech, AI Voice, AI Singing

Abstract

This article reports on some of the benefits that Artificial Intelligence has brought during the renaissance of AI science. It also reveals a few of the shortcomings surrounding it from 2010 until the beginning of 2025. The examples provided reflect our approaches regarding AI, motivating us to present them here briefly. The article reinforces that responsible development and integration of Artificial Intelligence in music is a priority.

References

1. Aimi, Inc. https://www.aimi.fm/.

2. Aiva Technologies SARL. https://www.aiva.ai/.

3. Alan Turing. https://www.britannica.com/biography/Alan-Turing.

4. Associated Press. “2023 was the year AI went mainstream. It was also the year we started to panic about it”. In Euronews, Dec. 27, 2023. https://www.euronews.com/next/2023/12/27/2023-was-the-year-ai-wentmainstream-it-was-also-the-year-we-started-to-panic-about-it.

5. Bellini, Valentina & Co. (Marco Cascella, Franco Cutugno, Michele Russo, Roberto Lanza, Christian Compagnone, Elena Bignami). “Understanding basic principles of artificial intelligence: a practical guide for intensivists”. In Acta Biomed, Vol. 93, No. 5: e2022297, 2022, pp. 1–15.

6. Borza, Adrian. AI Voices, YouTube channel. https://youtu.be/LegOnHdfs6Q.

7. Brad, Stelian. Technologies Behind Sophia Humanoid Robot, Technical University of Cluj-Napoca, Robotics, Feb. 12, 2023. https://utcn-robotica.ro/technologies-behind-sophia-humanoid-robot/.

8. Dauban, Nicolas. Our AI-Generated Music Identification journey, IRCAM Amplify, May 22, 2024. https://www.ircamamplify.io/blog/ai-generated-music-identification-journey.

9. Delaware Mubert, Inc. https://mubert.com/.

10. European Union. “Artificial Intelligence Act, Regulation (EU) 2024/1689”. In Official Journal, Jun. 13, 2024. https://artificialintelligenceact.eu/article/53/.

11. “Elektro Arts” Digital Arts Festival. Official social media page. https://www.facebook.com/elektroarts/videos/elektro-arts-2018/1513863638735815.

12. Google Cloud Text-to-Speech. https://cloud.google.com/text-to-speech.

13. Google DeepMind. https://deepmind.google/.

14. Google YouTube. https://www.youtube.com/@ai_music_official.

15. Hanson Robotics, Limited. https://www.hansonrobotics.com/.

16. IMB, Inc. What is machine learning? https://www.ibm.com/think/topics/machine-learning.

17. Iubu, Letiția Lucia. Inscripții pe un bob de grâu volume, MJM Edition, Craiova, 2018, pp. 1–112.

18. Jurafsky, Daniel & Martin, James H. Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition with Language Models, Third Edition (draft), Stanford University, 2024, pp. 1–29.

19. Karamolegkou, Antonia & Co. (Jiaang Li, Li Zhou, Anders Søgaard). “Copyright Violations and Large Language Models”. In ArXiv: Computer Science > Computation and Language, Cornell University, Oct. 20, 2023, pp. 1–10. https://arxiv.org/pdf/2310.13771.

20. Kunlun Tech Mureka. https://www.mureka.ai/.

21. Lauder, Ed. “Aiva is the first AI to Officially be Recognised as a Composer”. In AI Business, Mar. 10, 2017. https://aibusiness.com/verticals/aiva-is-the-first-ai-to-officially-be-recognised-as-a-composer.

22. Liu, Xiaoze & Co. (Ting Sun, Tianyang Xu, Feijie Wu, Cunxiang Wang, Xiaoqian Wang, Jing Gao). “SHIELD: Evaluation and Defense Strategies for Copyright Compliance in LLM Text Generation”, Purdue University – United States, Westlake University – China, pp. 1–31. In ArXiv: Computer Science > Computation and Language, Cornell University, Jun. 18, 2024. https://arxiv.org/pdf/2406.12975v1.

23. Manning, Christopher. Artificial Intelligence Definitions, Stanford University, HAI Human-Centered Artificial Intelligence, Sep. 2020. https://hai.stanford.edu/sites/default/files/2020-09/AI-Definitions-HAI.pdf.

24. Maslej, Nestor & Co. (Loredana Fattorini, Raymond Perrault, Vanessa Parli, Anka Reuel, Erik Brynjolfsson, John Etchemendy, Katrina Ligett, Terah Lyons, James Manyika, Juan Carlos Niebles, Yoav Shoham, Russell Wald, and Jack Clark). The AI Index 2024 Report, AI Index Steering Committee, Institute for Human-Centered AI, Stanford University, Stanford, CA, Apr. 2024, pp. 1–502. https://aiindex.stanford.edu/wp-content/uploads/2024/05/HAI_AI-Index-Report-2024.pdf.

25. McCarthy, John. https://www.britannica.com/biography/John-McCarthy.

26. McCarthy, John. What is Artificial Intelligence?, Computer Science Department, Stanford University, 2007. http://jmc.stanford.edu/articles/whatisai/whatisai.pdf.

27. Mercean-Țârc, Mirela. „Aici și acum, un spectacol New Media Art – Interviu cu compozitorul Adrian Borza” (“Here and Now” A New Media Spectacle – Interview with Composer Adrian Borza). In Colloquia Artium, 2, 2022, pp. 20–35.

28. Milmo Dan. “ChatGPT reaches 100 million users two months after launch”. In The Guardian, Feb. 2, 2023. https://www.theguardian.com/technology/2023/feb/02/chatgpt-100-million- users-open-ai-fastest-growing-app.

29. Musixy. https://musixy.ai/.

30. NVIDIA Inc. Large Language Models Explained. https://www.nvidia.com/en-us/glossary/large-language-models/.

31. Oord, Aaron van den & Co. (Sander Dieleman, Heiga Zen, Karen Simonyan, Oriol Vinyals, Alex Graves, Nal Kalchbrenner, Andrew Senior, Koray Kavukcuoglu). “WaveNet: A Generative Model for Raw Audio”. In ArXiv: Computer Science > Sound, Cornell University, Sep. 2016, pp. 1–15. https://arxiv.org/abs/1609.03499v2.

32. OpenAI OpCo, LLC. https://openai.com/.

33. Roose Kevin. “The Brilliance and Weirdness of ChatGPT”. In The New York Times, Dec. 5, 2022. https://web.archive.org/web/20230118134332/

34. https://www.nytimes.com/2022/12/05/technology/chatgpt-ai-twitter.html.

35. SACEM. “Special Conditions of Admission”. In Statutes 2024 and General Regulations 2024, pp. 1–68. https://societe.sacem.fr/docs/Statuts_UK_2024.pdf.

36. SACEM. The SACEM Repertoire. https://repertoire.sacem.fr/en/results?filters=parties&query=AIVA#searchBtn.

37. Skywork AI PTE. LTD. Melodio. https://www.melodio.ai/.

38. SoundCloud. https://soundcloud.com/a-i-music.

39. Supermusic. https://supermusic.ai/.

40. Turing, Alan M. “Computing Machinery and Intelligence”. In Mind, New Series, Vol. 59, No. 236, Oct. 1950, Oxford University Press on behalf of the Mind Association, pp. 443-460.

41. Universitatea Stanford, Institutul HAI. https://online.stanford.edu/schools-centers/stanford-institute-human-centered-artificial-intelligence-hai.

42. Zhao, Weijie & Co. (Huajie Shao, Zhaozhuo Xu, SuzhenDuan, and Denghui Zhang). “Measuring Copyright Risks of Large Language Model via Partial Information Probing”. In Proceedings of the 21st International Conference on Distributed Computing and Artificial Intelligence, New York, Oct. 21–25, 2024, pp. 1–8. https://arxiv.org/pdf/2409.13831v1.

Downloads

Published

2025-06-30

How to Cite

BORZA, A. (2025). Artificial Intelligence and Voice Modeling: Cutting-edge Technology in Music Production. Studia Universitatis Babeş-Bolyai Musica, 70(1), 287–299. https://doi.org/10.24193/subbmusica.2025.1.19

Issue

Section

Articles

Similar Articles

<< < 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 > >> 

You may also start an advanced similarity search for this article.