Yes, try that. Usually PIL should give you a warning about saving single channel images as jpg.
You are right regarding the speedup, however I think the workload in the first layer might be small compared to deeper layers, so that a potential speed gain might not be noticeable.