jitLLM

Java framework compiles directly to CUDA for GPU LLM inference

A new Java framework called jitLLM has been developed that compiles Java bytecode directly into CUDA, enabling LLM inference on NVIDIA GPUs without requiring Python or C++ sidecars. Developed by the TornadoVM team at th…