RLightning
/

Contents

  • What is RLightning?
  • Getting Started
    • Installation
    • Quickstart
    • Build Your Own Project
  • User Guide
    • System Architecture
    • Core Components
      • Engine
      • Env & EnvGroup
      • Policy & PolicyGroup
      • Data Buffer
      • Config
    • Configuration
    • Debug & Scaling Up
    • Build Your Own
      • Customize Policy
      • Customize Env
      • Customize Buffer
      • Customize Engine
    • Advanced
      • Placement Strategy
      • Performance Profiling
  • Benchmark
  • API Documentation
    • rlightning
      • rlightning.buffer
        • rlightning.buffer.utils
        • rlightning.buffer.base_buffer
        • rlightning.buffer.replay_buffer
        • rlightning.buffer.rollout_buffer
        • rlightning.buffer.sampler
      • rlightning.engine
        • rlightning.engine.async_rl_engine
        • rlightning.engine.async_rsl_rl_engine
        • rlightning.engine.base_engine
        • rlightning.engine.evaluation_engine
        • rlightning.engine.rsl_rl_engine
        • rlightning.engine.sync_rl_engine
      • rlightning.env
        • rlightning.env.remote_env
        • rlightning.env.utils namespace
        • rlightning.env.ale_env
        • rlightning.env.base_env
        • rlightning.env.env_group
        • rlightning.env.env_server
        • rlightning.env.isaac_env
        • rlightning.env.isaac_marl_env
        • rlightning.env.libero_env
        • rlightning.env.maniskill_env
        • rlightning.env.mujoco_env
        • rlightning.env.piper_env
      • rlightning.humanoid namespace
        • rlightning.humanoid.formatter
        • rlightning.humanoid.loader
        • rlightning.humanoid.retarget
        • rlightning.humanoid.utils
        • rlightning.humanoid.data_retriever
        • rlightning.humanoid.types
      • rlightning.models namespace
        • rlightning.models.mlp
        • rlightning.models.modules namespace
        • rlightning.models.openpi namespace
        • rlightning.models.openvla namespace
        • rlightning.models.toy_model
        • rlightning.models.vision
        • rlightning.models.model_utils
      • rlightning.policy
        • rlightning.policy.rsl_rl_policy
        • rlightning.policy.simple_ppo_policy
        • rlightning.policy.utils namespace
        • rlightning.policy.vla_policy
        • rlightning.policy.base_policy
        • rlightning.policy.policy_group
        • rlightning.policy.supervised_policy
      • rlightning.types
        • rlightning.types.batched_data
        • rlightning.types.env_rets
        • rlightning.types.metadata
        • rlightning.types.policy_response
      • rlightning.utils namespace
        • rlightning.utils.config
        • rlightning.utils.distributed
        • rlightning.utils.inference_engine
        • rlightning.utils.logger
        • rlightning.utils.placement
        • rlightning.utils.profiler namespace
        • rlightning.utils.progress
        • rlightning.utils.ray
        • rlightning.utils.registry
        • rlightning.utils.zmq
        • rlightning.utils.builders
        • rlightning.utils.common
        • rlightning.utils.launch
        • rlightning.utils.utils
      • rlightning.weights
        • rlightning.weights.utils
        • rlightning.weights.weight_buffer
        • rlightning.weights.weight_buffer_mixin
        • rlightning.weights.weight_transfer_manager
  • Contribution
    • Contributing Guide

On this page

  • create_vllm_engine()
  • Submodules
  1. RLightning /
  2. API Documentation /
  3. rlightning /
  4. rlightning.utils namespace /
  5. rlightning.utils.inference_engine

rlightning.utils.inference_engine¶

rlightning.utils.inference_engine.create_vllm_engine(model_config, rollout_mode='sync')[source]¶

Submodules¶

  • rlightning.utils.inference_engine.vllm_engine
Previous
rlightning.utils.distributed.initialize
Next
rlightning.utils.inference_engine.vllm_engine

Made with Sphinx and Shibuya theme.