Embedded Interop Between Clojure, R, and Python With GraalVM
In my talk at Clojure Conj I mentioned how a project from Oracle Labs named GraalVM might have to potential for Clojure to interop with Python on the same VM. At the time of the talk, I had just learned about it so I didn’t have time to take a look at it. Over the last week, I’ve managed to take it for a test drive and I wanted to share what I found.
Are you ready?
In this example, we will be using an ordinary Leinengen project and using the REPL we will interop with both R and python.
But first will need a bit of setup.
We will download the Graal project so we can use its
java instead of our own.
Once we have it downloaded we will configure our PATH to use Graal’s java instead of our own.
Now, we can create a new lein project and run
lein repl and begin the fun.
The Polyglot Context
In our new namespace, we just need to import the Polyglot Context to get started:
1 2 3 4 5
Now, we are ready to actually try to run some R and Python code right in our REPL. Let’s start first with R.
Interoping with R
The main function we are going to use is the
eval function in the context. Let’s start small with some basic math.
1 2 3 4
Wow! It actually did something. It returned something called a Polyglot Value with what looks like the right answer in it.
Emboldened by our early success, let’s try something a little more complicated like calling a function.
1 2 3 4 5 6 7
Again, it looks like it worked. Let’s try to get the result back into Clojure as a value we can work with. We could ask the result what sort of type it is with
but let’s just use
clojure.edn to read the string and save some time.
1 2 3 4 5 6
It would be nice to have a easier way to export symbols and import symbols to and from the guest and host language. In fact, Graal provides a way to do this but to do this in Clojure, we would need something else called Truffle.
Truffle is part of the Graal project and is a framework for implementing languages with the Graal compliler. There are quite a few languages implemented with the Truffle framework. R is one of them.
My understanding is that if Clojure was implemented as a truffle lang, then interop could be much more seamless like this example in Ruby
But let’s continue in our exploration. What about doing something more interesting, like importing a useful R library and using it. How about the numDeriv package that supports Accurate Numerical Derivatives?
First we import the package using cran.
1 2 3
If you are doing this at your REPL, you can will see lots of text going on in your
lein repl process at this point. It’s going out and figuring out what deps you need and installing them in your
/graalvm-0.28.2/jre/languages/R directory structure.
After it is done, we can actually use it!
1 2 3 4 5 6 7 8 9
This has a bit more interesting result as an array. But the Context has ways of dealing with it.
1 2 3 4 5 6 7 8 9
So, we’ve showed basic interop with R – which is pretty neat. What about Python?
Interoping with Python
Truffle is scheduled to fully support Python in 2018, but there is already an early alpha version in the Graal download that we can play with.
1 2 3 4 5
It is still a long way for
import numpy or
import tensorflow but cPython compatibility is the goal. Although the c-extensions are the really tricky part.
So keep an eye on Graal and Truffle for the future and wish the Oracle Labs team the best on their mission to make the JVM Polyglot.
If you are interested in playing with the code. I have a github repo here graal-test. If you are interested in watching a video, I really liked this one. There are also some really nice examples of running in polyglot mode with R and Java and JS here https://github.com/graalvm/examples.