Body: <p>I'm planning an RL project and I have to decide which RL framework do I use if any at all. The project has a highly custom environment, and testing different algorithms will be required to obtain optimal results. Furthermore, it will use a custom neural network, not implemented in the popular TensorFlow/PyTorch ML frameworks. Therefore, the framework should allow for customization with regard to approximation function (1) and the environment (2). The problem is that to my current knowledge, most of the framework allows only to work with a built-in environment. Does anybody know a framework that meets the two conditions (1) and (2)? Or anybody knows a review that contains information about framework in the context of those conditions?</p>
  
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2020-09-18T13:16:16.953Z
Comments.Text: Although I asked you to clarify your actual question, I don't think that asking "which library/framework is most suited for my task" is on-topic here, as our on-topic page (https://ai.stackexchange.com/help/on-topic, please, read our on-topic page) says. Given that this is related to reinforcement learning, I will leave it open for a while, but questions that ask for libraries, datasets or GPUs are probably more suited for Data Science SE, but I don't ensure you that they are on-topic there, given I am not familiar with the details of that site.
Comments.UserDisplayName: nbro
Comments.ContentLicense: CC BY-SA 4.0
Comments.CreationDate: 2020-10-18T16:40:40.227Z
Comments.Text: You can modify the environments and create custom models using Ray RLlib: https://docs.ray.io/en/latest/rllib.html
Comments.UserDisplayName: Tom Dörr
Tags: <reinforcement-learning><python>
Title: What framework for a project with a custom environment?
UserDisplayName: Daniel Wiczew
ThreadText: # What framework for a project with a custom environment?
  
  (Asked by: username_0 on 2020-09-18)
  
  I'm planning an RL project and I have to decide which RL framework do I use if any at all. The project has a highly custom environment, and testing different algorithms will be required to obtain optimal results. Furthermore, it will use a custom neural network, not implemented in the popular TensorFlow/PyTorch ML frameworks. Therefore, the framework should allow for customization with regard to approximation function (1) and the environment (2). The problem is that to my current knowledge, most of the framework allows only to work with a built-in environment. Does anybody know a framework that meets the two conditions (1) and (2)? Or anybody knows a review that contains information about framework in the context of those conditions?
  
  **Tags:** reinforcement-learning, python
  
  > **Comments:**
  > **username_1**: Although I asked you to clarify your actual question, I don't think that asking "which library/framework is most suited for my task" is on-topic here, as our on-topic page (https://ai.stackexchange.com/help/on-topic, please, read our on-topic page) says. Given that this is related to reinforcement learning, I will leave it open for a while, but questions that ask for libraries, datasets or GPUs are probably more suited for Data Science SE, but I don't ensure you that they are on-topic there, given I am not familiar with the details of that site.  
  > **username_2**: You can modify the environments and create custom models using Ray RLlib: https://docs.ray.io/en/latest/rllib.html  
  
  ---
  
  ## 0 answers
  
  