To determine the maximum tolerated dose (MTD) and dose limiting toxicities (DLT) of the combination of temsirolimus and pemetrexed, as well as the response rate. The starting dose (Dose Level 1) and schedule of pemetrexed will be 500 mg/m^2 given every 3 weeks and the starting dose (Dose Level 1) for temsirolimus will be 15 mg given weekly for 3 weeks, to complete 1 cycle. In subsequent cohorts, dose will be escalated or de-escalated. Enrollment to each cohort is based on toxicity experienced at that dose level.