vecbuf#

Source code: tianshou/data/buffer/vecbuf.py

class HERVectorReplayBuffer(total_size: int, buffer_num: int, **kwargs: Any)[source]#

HERVectorReplayBuffer contains n HERReplayBuffer with same size.

It is used for storing transition from different environments yet keeping the order of time.

Parameters:

  • total_size – the total size of HERVectorReplayBuffer.

  • buffer_num – the number of HERReplayBuffer it uses, which are under the same configuration.

Other input arguments are the same as HERReplayBuffer.

See also

Please refer to ReplayBuffer for other APIs’ usage.

class PrioritizedVectorReplayBuffer(total_size: int, buffer_num: int, **kwargs: Any)[source]#

PrioritizedVectorReplayBuffer contains n PrioritizedReplayBuffer with same size.

It is used for storing transition from different environments yet keeping the order of time.

Parameters:

  • total_size – the total size of PrioritizedVectorReplayBuffer.

  • buffer_num – the number of PrioritizedReplayBuffer it uses, which are under the same configuration.

Other input arguments (alpha/beta/stack_num/ignore_obs_next/save_only_last_obs/ sample_avail) are the same as PrioritizedReplayBuffer.

See also

Please refer to ReplayBuffer for other APIs’ usage.

set_beta(beta: float) → None[source]#
class VectorReplayBuffer(total_size: int, buffer_num: int, **kwargs: Any)[source]#

VectorReplayBuffer contains n ReplayBuffer with the same size.

It is used for storing transition from different environments yet keeping the order of time.

Parameters:

  • total_size – the total size of VectorReplayBuffer.

  • buffer_num – the number of ReplayBuffer it uses, which are under the same configuration.

Other input arguments (stack_num/ignore_obs_next/save_only_last_obs/sample_avail) are the same as ReplayBuffer.

See also

Please refer to ReplayBuffer for other APIs’ usage.