- Mar 24, 2023
-
-
emailweixu authored
* Gracious quit of fast_parallel_environment Previously, when there are a lot of parallel environments, ctrl-C often cannot terminate the training successfully. Although "ctrl-|" can be used to terminate, it leaves the system is a bad state which subsequent training often fails. This PR make the ProcessEnvironment detect the KeyboardInterrupt and inform the main process to quit by throwing an exception. This exception will be handled in python code and thus calling FastParallelEnvironment.close() to graciouly terminate all the processes. * Showing progress for closing all processes
-
- Mar 23, 2023
-
-
Haichao Zhang authored
* Short message on in-algorithm checkpoint loaded * use common.info
-
- Mar 22, 2023
- Mar 18, 2023
-
-
Haonan Yu authored
Added the missing Boost after PR fast parallel environment
-
- Mar 17, 2023
-
-
emailweixu authored
* FastParallelEnvironment * Address comments Also fixed a bug of not copying step and reset result. * Address comments * Fix unittests * Improve setup.py pybind11 is not always available. Add it as a prerequisite for setup in pyproject.toml
-
- Mar 16, 2023
-
-
le-horizon authored
(cherry picked from commit 11318a98b839b37575052b2db233615b87cc91db) Co-authored-by:
Le Horizon <le.zhao+git@horizon.ai>
-
Haonan Yu authored
* correctly check if a thread env should be created or not * fix format
-
emailweixu authored
Previously, there is the warning even if there is no unused parameter, which can be confusing. Change to only show the warning if there are actually unused parameters.
-
emailweixu authored
Previously, confirm_checkpoint_upon_crash is not set False for some test (e.g ac_cart_pole), which caused failed test waiting indefinitely.
-
- Mar 14, 2023
-
-
Haonan Yu authored
* fix alf snapshot in grid search dirs * fix format
-
Haichao Zhang authored
* Fix save optimizer checkpoint * Use pretty format on the structure file
-
- Mar 13, 2023
-
-
Haonan Yu authored
* update cicd docker and alf gpu docker usage * update alf software dependencies for cuda 11.4 * fix cicd docker file dependencies * upgrade absl-py to be compatible with py38 * numpy version fixed to 1.23 * np.asscalar is deprecated in new numpy * simple_value no longer works after upgrading * skip test_mbrl_latent_pendulum * upgrade tensorboard to 2.6.0 * upgrade cnest to 1.1.1 (fixed segfault) * revert test case comments
-
- Mar 11, 2023
-
-
Pin Zhang authored
-
- Mar 07, 2023
-
-
Haichao Zhang authored
* Save checkpoint structure * Save checkpoint structure to json * Address comments
-
- Mar 06, 2023
- Feb 24, 2023
-
-
Break Yang authored
-
- Feb 22, 2023
-
-
Haichao Zhang authored
-
Haichao Zhang authored
* In algorithm checkpoint pre-loading * Explicitly call _post_init() since decorator conflicts with alf.config * init_sub_class * Enable auto post_init call; change to prefix@path * Address comments * Address more comments
-
- Feb 18, 2023
-
-
Haonan Yu authored
* normalized action alf wrapper; transform_nest supports numeric fields * address comments * code style fix
-
- Feb 17, 2023
-
-
emailweixu authored
* Update contributing.rst about git pull For new version of git, the default `git pull` will rebase, which is what we want to avoid. So we need to update the instruction. * Update contributing.rst
-
Haichao Zhang authored
-
- Feb 15, 2023
-
-
Haonan Yu authored
-
le-horizon authored
* running spare env code for slow env resets, still need to figure out why reset takes 2+ seconds. * fix pack_sequence_as(ts_spec) with ts_spec_with_env_info * fix env_id in returned timesteps, with test * Allow early reset even when num_spare_envs = 0, with test case.
-
- Feb 14, 2023
-
-
Haichao Zhang authored
-
- Feb 07, 2023
-
-
Haichao Zhang authored
-
- Jan 11, 2023
-
-
Haonan Yu authored
* alf snapshot only copies alf module * fix examples dir
-
- Dec 30, 2022
-
- Dec 20, 2022
-
-
Haichao Zhang authored
-
Haonan Yu authored
-
Haonan Yu authored
-
- Nov 22, 2022
-
-
Haichao Zhang authored
* get_mode for mixture distribution * Add comments * Address comments
-
- Nov 12, 2022
-
-
Haonan Yu authored
* add RandomCrop gym wrapper * address comments
-
Break Yang authored
-
- Nov 10, 2022
-
-
Break Yang authored
-
- Nov 02, 2022
-
-
Break Yang authored
* Unify ParallelNormalProjectionNetwork and NormalProjectionNetwork * Add make_parallel() back for normal projection network * Add parallel FC version of make_parallel to BetaProjectionNetwork * Implement the MixtureProjectionNetwork * Address comments
-
Break Yang authored
* Unify ParallelNormalProjectionNetwork and NormalProjectionNetwork * Add make_parallel() back for normal projection network * Add parallel FC version of make_parallel to BetaProjectionNetwork
-
Haichao Zhang authored
* VQ VAE Algorithm * Address comments * Fix embedding summary
-
- Nov 01, 2022
-
-
Break Yang authored
* Support replace() for TensorSpec * Add type hints for replace()
-