- 增加音频转文字的功能 - feature

[cdguy]

Hello @kingslay with pure curiosity, I would like to know in which context we can use the new feature you added (增加音频转文字的功能) with the last commit?

thanks!

[kingslay]

我是打算把这个做成一个功能：实时把播放的音频转为文字。实现实时字幕的能力。但是初步尝试了下。苹果的离线音频识别效果不是很好。这个功能还比较简陋。

[cdguy]

Especially when watching a foreign documentary channel, or a kind of channel, that would be a great feature to have live subtitles in order to have an idea about what it is said 👍🏻

[cdguy]

@kingslay
https://github.com/curtgrimes/webcaptioner
https://github.com/LinkonBSMRSTU/Speech-To-Text-App-iOS
https://github.com/ggerganov/whisper.cpp
https://github.com/nl8590687/ASRT_SpeechRecognition
https://github.com/m-bain/whisperX
https://github.com/jianchang512/pyvideotrans
https://github.com/coqui-ai/STT

I found some libraries that might inspire you

[cdguy]

https://developer.apple.com/documentation/speech/
https://developer.apple.com/tutorials/app-dev-training/transcribing-speech-to-text
https://developer.apple.com/documentation/speech/recognizing_speech_in_live_audio

https://developer.apple.com/videos/play/wwdc2023/10101/

https://medium.com/@kamil.tustanowski/speech-recognition-using-the-speech-framework-72d31f4f344a

https://github.com/dtinth/transcribe

https://medium.com/@kegoaps/audio-file-speech-transcription-using-sfspeechrecognizer-on-swiftui-5be019c81afe

[kingslay]

我在app上增加了英语 ai字幕的能力。但是效果不是很好。你可以体验下。目前是使用apple的本地ai能力。

[cdguy]

我在app上增加了英语 ai字幕的能力。但是效果不是很好。你可以体验下。目前是使用apple的本地ai能力。

The moment select Ai subtitles, the app crashes. Sent testflight crash report

[kingslay]

如果音频是dolby atoms的话，那会crash。你可以用其他的音频例如 双声道的立体声