Access & ServingClosest to model workloads15Model API gateways4LiteLLM92.2OpenRankOmniRoute31.9OpenRankNew API11OpenRankHigress5.3OpenRankServing / Deploy3Ollama167OpenRankNVIDIA Dynamo115.9OpenRankllm-d19.7OpenRankServing / Inference8SGLang215OpenRankvLLM189.1OpenRankTensorRT-LLM145.8OpenRankllama.cpp90.5OpenRankvLLM Omni54.3OpenRankONNX Runtime46.9OpenRankOpenVINO27.3OpenRankLMCache18OpenRank
Model TrainingPost-train and pre-train systems27Post-Train / RL & environments6NeMo RL35.7OpenRankVerl22.9OpenRankTRL22.8OpenRankRLinf10.1OpenRankAReaL6.5OpenRankOpenEnv—OpenRankPost-Train / Supervised fine-tuning3Unsloth28.5OpenRankms-swift13.7OpenRankLLaMA Factory—OpenRankPre-Train / Framework & parallel6PyTorch333.3OpenRankJAX121.5OpenRankMegatron-LM32.4OpenRankPaddlePaddle23.9OpenRankTensorflow9.6OpenRankDeepSpeed5.7OpenRankPre-Train / Compiler & accelerator8Flashinfer147.8OpenRankTriton42OpenRankNVIDIA Model Optimizer36.9OpenRankTransformer Engine17.7OpenRankOpenXLA11.5OpenRankCUTLASS6OpenRankFlashAttention5.4OpenRankDeepEP—OpenRankPre-Train / Evaluation & observability2Weights & Biases33.9OpenRankMLflow31.5OpenRankPre-Train / Robotics infra2LeRobot9.8OpenRankOpenMind OM1—OpenRank
Data & ComputeFoundation for model development17Data / Labeling2CVAT6.3OpenRankLabel Studio2OpenRankData / Integration4Apache Airflow98.3OpenRankDocling40.2OpenRankAirbyte20.6OpenRankMarkitdown2.1OpenRankData / Governance7OpenMetadata47.5OpenRankDataHub39OpenRankApache Iceberg34.9OpenRankApache Hudi24.4OpenRankApache Gravitino22OpenRankApache Paimon16.4OpenRankDelta Lake15.7OpenRankCompute & scheduling4Ray71.5OpenRankApache Spark68.2OpenRankVolcano9.7OpenRankKserve9.6OpenRank