Unfortunately RL Glue is not nearly as good as it looks or sounds. I was thinking about using it to solve some problems I have (for example, I was interested in modeling embryo selection for complex traits as a POMPD to see what the optimal approaches might be rather than settling for a simple calculation as I did in <a href="http:&#x2F;&#x2F;www.gwern.net&#x2F;Embryo%20selection" rel="nofollow">http:&#x2F;&#x2F;www.gwern.net&#x2F;Embryo%20selection</a> ), but the project is abandoned, and while it implements an interface&#x2F;IPC glue, there are few implementations of any interesting environments or useful agents, so you would wind up writing everything yourself anyway. Once I got the simple tabular agent example working, I went looking at the more complex ones and was quite disappointed.<p>From the description in OP, it already far exceeds RL Glue&#x27;s usefulness.