Could you try to narrow down the issue a bit further by removing specific parts from your code and checking, if the memory is still increasing?
E.g. you could start with the (metric) logging, then the transformations, then using a single worker etc.