GitHub

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework ...

👉 Try Gemma4-E4B with MTP on Linux, macOS, Windows or Raspberry Pi with the LiteRT-LM CLI: litert-lm run \ --from-huggingface-repo=litert-community/gemma-4-E4B-it ...