Ruby

[ggerganov]

General discussion about the ruby bindings for whisper.cpp

Current state: bindings/ruby

Initial merge: #500
CC: @taf2

[taf2]

Working on getting a gem published to rubygems so people can just

gem install whispercpp

[taf2]

Looks like someone already published a gem named whisper... So I think if we go with whispercpp - that would make sense and is available. Will work on pushing a gem and pull request.

[taf2]

@ggerganov I'm looking for good solution to interrupt whisper_full_parallel. In ruby we can wrap the call to this in an unlock method, since ruby has a global interpreter lock it is ideal to unlock while the c++ code runs allowing ruby to run other threads and even be interrupted via ctrl+c and other interrupt signals. It looks whisper_full_parallel calls whisper_full in each thread or just calls whisper_full, if there was a maybe volatile stop variable we added to the context then we could toggle that to false/0 and cause the while loop to break. thoughts?

[ggerganov]

There is currently an existing abort mechanism via the "encoder_begin" callback:

whisper.cpp/whisper.h

Lines 240 to 245 in f420de1

	// Encoder begin callback
	// If not NULL, called before the encoder starts
	// If it returns false, the computation is aborted
	typedef bool (*whisper_encoder_begin_callback)(struct whisper_context * ctx, void * user_data);

Would this work?

[taf2]

ah perfect - i'll dig into this and rework the ruby bindings to use that shortly.

[ggerganov]

Usage of the abort mechanism is demonstrated here:

whisper.cpp/examples/main/main.cpp

Lines 603 to 616 in b4ebdb6

	// example for abort mechanism
	// in this example, we do not abort the processing, but we could if the flag is set to true
	// the callback is called before every encoder run - if it returns false, the processing is aborted
	{
	static bool is_aborted = false; // NOTE: this should be atomic to avoid data race
	wparams.encoder_begin_callback = [](struct whisper_context * /*ctx*/, void * user_data) {
	bool is_aborted = *(bool*)user_data;
	return !is_aborted;
	};
	wparams.encoder_begin_callback_user_data = &is_aborted;
	}