ruby streaming client to Ignite

Hello

We have the need to stream data from Kafka to Ignite - the distributed
memory database.
I read carefully on this doc:

It has only consumer API, producer API, and admin/monitoring API. There is
no streaming API available.

And I read this doc as well:

Which is easy to use. But it has no streaming feature supported either.
Ignite has the official Kafka connector but it's in Java, while my current
project is using Ruby.
Do you know there is any solution for this?

Thanks & Regards.

Have you looked at using JRuby?

···

On Tue, Dec 21, 2021 at 7:06 PM Wes Peng <pentwes@gmail.com> wrote:

Ignite has the official Kafka connector but it's in Java, while my current project is using Ruby.
Do you know there is any solution for this?

--
Hassan Schroeder ------------------------ hassan.schroeder@gmail.com
twitter: @hassan
Consulting Availability : Silicon Valley or remote

Sorry, I have no personal experience on JRuby.

···

On Wed, Dec 22, 2021 at 11:18 AM Hassan Schroeder < hassan.schroeder@gmail.com> wrote:

On Tue, Dec 21, 2021 at 7:06 PM Wes Peng <pentwes@gmail.com> wrote:

> Ignite has the official Kafka connector but it's in Java, while my
current project is using Ruby.
> Do you know there is any solution for this?

Have you looked at using JRuby?

--
Hassan Schroeder ------------------------ hassan.schroeder@gmail.com
twitter: @hassan
Consulting Availability : Silicon Valley or remote

Unsubscribe: <mailto:ruby-talk-request@ruby-lang.org?subject=unsubscribe>
<ruby-talk list: member options login page>

"The best time to plant a tree is twenty years ago; the second best
time is now" :grinning:

If I wanted to use a Java library with Ruby, that's the first and most
obvious thing I'd look into.

Good luck!

···

On Tue, Dec 21, 2021 at 7:45 PM Wes Peng <pentwes@gmail.com> wrote:

Sorry, I have no personal experience on JRuby.

--
Hassan Schroeder ------------------------ hassan.schroeder@gmail.com
twitter: @hassan
Consulting Availability : Silicon Valley or remote

Hi Wes Peng,

···

On 2021-12-22 11:17 am, Hassan Schroeder wrote:

On Tue, Dec 21, 2021 at 7:06 PM Wes Peng <pentwes@gmail.com> wrote:

Ignite has the official Kafka connector but it's in Java, while my current project is using Ruby.
Do you know there is any solution for this?

Have you looked at using JRuby?

Using JRuby is not difficult. It is basically Ruby running on a Java Virtual Machine and is practically identical. One of the big things that it brings is the ability to connect to Java JARs and use them directly from your Ruby code. If it helps, I have some very basic getting started posts about JRuby on my blog: Tags

The official wiki has this documentation on calling Java from Ruby/ JRuby: CallingJavaFromJRuby · jruby/jruby Wiki · GitHub
I also have been intending to write a post about using the Apache Poi Jars from Ruby (JRuby) to illustrate the same thing based on the samples that I have in a repo here: GitHub - mohits/rb-xlsx-converter-comparison: Sample code for comparing performance of XLSX converters from Ruby and your post motivates me to try to get that done sooner :slight_smile:

Holler if you need help. There's also a JRuby mailing list.

Best Regards,
Mohit.

Thanks @Mohit. I will try to look at JRuby.

···

On Wed, Dec 22, 2021 at 1:46 PM Mohit Sindhwani <mo_mail@onghu.com> wrote:

Hi Wes Peng,

On 2021-12-22 11:17 am, Hassan Schroeder wrote:
> On Tue, Dec 21, 2021 at 7:06 PM Wes Peng <pentwes@gmail.com> wrote:
>
>> Ignite has the official Kafka connector but it's in Java, while my
current project is using Ruby.
>> Do you know there is any solution for this?
> Have you looked at using JRuby?

Using JRuby is not difficult. It is basically Ruby running on a Java
Virtual Machine and is practically identical. One of the big things that it
brings is the ability to connect to Java JARs and use them directly from
your Ruby code. If it helps, I have some very basic getting started posts
about JRuby on my blog: Tags

The official wiki has this documentation on calling Java from Ruby/ JRuby:
CallingJavaFromJRuby · jruby/jruby Wiki · GitHub
I also have been intending to write a post about using the Apache Poi Jars
from Ruby (JRuby) to illustrate the same thing based on the samples that I
have in a repo here:
GitHub - mohits/rb-xlsx-converter-comparison: Sample code for comparing performance of XLSX converters from Ruby and your post
motivates me to try to get that done sooner :slight_smile:

Holler if you need help. There's also a JRuby mailing list.

Best Regards,
Mohit.

Unsubscribe: <mailto:ruby-talk-request@ruby-lang.org?subject=unsubscribe>
<ruby-talk list: member options login page>