Generative adversarial networks in sound synthesis: analysis of sound modeling capabilities using GANs.
Article Sidebar
Issue Vol. 39 (2026)
-
Comparative analysis of user interface quality of mobile operator applications
Darya Benedziktovich, Oleksii Davydok102-107
-
Comparative analysis of non-relational databases on the example of Amazon DynamoDB and MongoDB
Michał Sagan, Małgorzata Plechawska-Wójcik108-114
-
Generative adversarial networks in sound synthesis: analysis of sound modeling capabilities using GANs.
Michał Galant, Paweł Powroźnik115-122
-
Analysis of LEAPET: a new energy-aware routing protocol for Internet of Things-based Heterogeneous Wireless Sensor Network
Kazeem B. Adedeji123-131
-
Comparative analysis of query optimization techniques in modern relational database systems
Volodymyr Solohub, Volodymyr Pashkevych132-137
-
Statistical analysis of the results of real dice rolls using the object detection model in the context of the Central Limit Theorem
Kacper Gębusia, Edyta Łukasik138-145
-
Analysis of usability and accessibility of Polish web services for English language testing
Michał Billewicz, Natalia Bogusz, Maria Skublewska-Paszkowska146-153
-
Comparative analysis of reactive programming and Java virtual threads
Daniel Charlak, Jakub Brzeziński, Grzegorz Kozieł154-160
-
Comparative analysis of the security of instant messaging apps
Natalia Pioterczak, Maksymilian Potocki, Piotr Kopniak161-166
-
Comparative analysis of chosen programming languages
Jakub Machnowski, Marta Dziuba-Koziel167-175
-
Comparative performance analysis of Express.js and Spring Boot in CRUD-oriented web applications
Wojciech Wnuk, Małgorzata Plechawska-Wójcik176-182
-
Comparative performance analysis of Spring Boot and Ktor for a ticket reservation REST API on the JVM
Miłosz Serej, Kamil Kopciński, Jakub Smołka183-187
Main Article Content
Authors
Abstract
This paper explores the capabilities of Generative Adversarial Networks (GANs) for audio synthesis. Particularly, it focus on WaveGAN, which works directly with raw waveforms, and DCGAN trained on spectrogram representations. These models were trained using internal combustion engine sounds collected from the Google AudioSet corpus. The study aims to assess how data representation and architectural choices affect not only quality but also training dynamics in synthesis. It exposed different behavioral characteristics of both approaches thus underlining the fact that signal representation largely defines the generative process and perceptual properties of output. Modelling on spectrograms, even though phase information is naturally lost, proved more robust and stable than waveform generation directly from waveforms. The results have further affirmed that a fair share of decisive synthesis quality with GAN-based audio synthesis resides in factors including data complexity, the domain of representation, and hyperparameter configuration.
Keywords:
Sustainable Development Goals (SDG)
- 9 - Industry, Innovation, Technology and Infrastructure
References
[1] I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. Warde-Farley, S. Ozair, A. Courville, Y. Bengio, Generative Adversarial Networks, Communications of the ACM, 63(11) (2014) 139-144, https://doi.org/10.1145/3422622. DOI: https://doi.org/10.1145/3422622
[2] J. Gui, Z. Sun, Y. Wen, D. Tao, J. Ye, A Review on Generative Adversarial Networks: Algorithms, Theory, and Applications, IEEE transactions on knowledge and data engineering, 35(4) (2021) 3313-3332, https://doi.org/10.1109/TKDE.2021.3130191. DOI: https://doi.org/10.1109/TKDE.2021.3130191
[3] Documentation of the Google’s AudioSet dataset, https://research.google.com/audioset/index.html, [03.2025].
[4] J. W. Kim, R. Bittner, A. Kumar, J. P. Bello, Neural Music Synthesis for Flexible Timbre Control, In ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (2019) 176-180, https://doi.org/10.1109/ICASSP.2019.8683596. DOI: https://doi.org/10.1109/ICASSP.2019.8683596
[5] T. Bazin, G. Hadjeres, P. Esling, M. Malt, Spectrogram Inpainting for Interactive Generation of Instrument Sounds, arXiv preprint arXiv:2104.07519 (2021), https://doi.org/10.48550/arXiv.2104.07519.
[6] S. H. Hawley, B. L. Colburn, S. I. Mimilakis, Profiling musical audio processing effects with deep neural networks, The Journal of the Acoustical Society of America 144(3) (2018) 1753, https://doi.org/10.1121/1.5067764. DOI: https://doi.org/10.1121/1.5067764
[7] A. Jabbar, X. Li, B. Omar, A Survey on Generative Adversarial Networks: Variants, Applications and Training, ACM Computing Surveys (CSUR), 54(8) (2021) 1-49, https://doi.org/10.1145/3463475. DOI: https://doi.org/10.1145/3463475
[8] J. Berezutskaya, L. Ambrogioni, N. F. Ramsey, M. A. J. van Gerven, Towards Naturalistic Speech Decoding from Intracranial Brain Data, In 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) (2022) 3100-3104, https://doi.org/10.1109/EMBC48229.2022.9871301. DOI: https://doi.org/10.1109/EMBC48229.2022.9871301
[9] C. Donahue, J. McAuley, M. Puckette, Adversarial Audio Synthesis, arXiv preprint arXiv:1802.04208 (2018), https://doi.org/10.48550/arXiv.1802.04208.
[10] K. Kumar, R. Kumar, T. de Boissiere, L. Gestin, W. Z. Teoh, J. Sotelo, A. de Brebisson, Y. Bengio, A. Courville, MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesis, arXiv preprint arXiv:1910.06711v3 (2019), https://doi.org/10.48550/arXiv.1910.06711.
[11] J. Engel, K. Krishna Agrawal, S. Chen, I. Gulrajani, C. Donahue, A. Roberts, GANSynth: Adversarial Neural Audio Synthesis, arXiv preprint arXiv:1902.08710 (2019), https://doi.org/10.48550/arXiv.1902.08710.
[12] C. Wang, C. Zeng, J. Chen, O. Xue, HiFi-WaveGAN: Generative Adversarial Network with Auxiliary Spectrogram-Phase Loss for High-Fidelity Singing Voice Generation, In International Symposium on Neural Networks. Singapore: Springer Nature Singapore (2024) 80-92, https://doi.org/10.1007/978-981-97-4399-5_8. DOI: https://doi.org/10.1007/978-981-97-4399-5_8
[13] X. Liu, W. Zhang, Z. Zheng, M. Pan, R. Wang, FGP-GAN: Fine-Grained Perception Integrated Generative Adversarial Network for Expressive Mandarin Singing Voice Synthesis, IEEE Transactions on Consumer Electronics, 70(3) (2023) 6054-6063, https://doi.org/10.1109/TCE.2024.3412053. DOI: https://doi.org/10.1109/TCE.2024.3412053
[14] P. Chandna, M. Blaauw, J. Bonada, E. Gómez, WGANSing: A Multi-Voice Singing Voice Synthesizer Based on the Wasserstein-GAN, In 2019 27th European signal processing conference (EUSIPCO) (2019) 1-5, https://doi.org/10.23919/EUSIPCO.2019.8903099. DOI: https://doi.org/10.23919/EUSIPCO.2019.8903099
[15] J. Nistal, C. Aouameur, I. Velarde, S. Lattner, DrumGAN VST: A Plugin for Drum Sound Analysis/Synthesis with Autoencoding Generative Adversarial Networks, arXiv preprint arXiv:2206.14723 (2022), https://doi.org/10.48550/arXiv.2206.14723.
[16] A. Madhu, K. Suresh, EnvGAN: A GAN-based Augmentation to Improve Environmental Sound Classification, Artificial intelligence review, 55(8) (2022) 6301-6320, https://doi.org/10.1007/s10462-022-10153-0. DOI: https://doi.org/10.1007/s10462-022-10153-0
[17] S. Liao, S. Lan, A. G. Zachariah, EVA-GAN: Enhanced Various Audio Generation via Scalable Generative Adversarial Networks, arXiv preprint arXiv:2402.00892 (2024), https://doi.org/10.48550/arXiv.2402.00892.
[18] L. Wyse, P. Kamath, C. Gupta, Sound Model Factory: An Integrated System Architecture for Generative Audio Modelling, In International Conference on Computational Intelligence in Music, Sound, Art and Design (Part of EvoStar) (2022) 308-322, https://doi.org/10.1007/978-3-031-03789-4_20. DOI: https://doi.org/10.1007/978-3-031-03789-4_20
[19] S. Andreu, M. Villanueva Aylagas, Neural Synthesis of Sound Effects Using Flow-Based Deep Generative Models, Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment 18(1) (2022) 2-9, https://doi.org/10.1609/aiide.v18i1.21941. DOI: https://doi.org/10.1609/aiide.v18i1.21941
Article Details
Abstract views: 148

