Running two external 4k displays over thunderbolt to HDMI MacBook Pro (Retina, 15-inch, Late 2013) I have a MacBook Pro (Retina, 15-inch, Late 2013).

Can I use two 3840 x 2160 external monitors over Thunderbolt 2 to HDMI connections if the laptop is in closed-display mode?

I would be perfectly happy with 30Hz refresh rate.
Yes you can for the MacBook Pro (Retina, Late 2013) and later

If you use a 60Hz Multi Stream Transport display with the MacBook Pro with AMD Radeon R9 M370X graphics card only one additional Thunderbolt display is supported.

You can use 4K displays and Ultra HD TVs at the following resolutions and refresh rates via the built-in HDMI port of your Mac:

3840 x 2160 at 30Hz
4096 x 2160 at 24Hz (mirroring is not supported at this resolution)

Check out this page from Apple  https://support.apple.com/kb/sp690?locale=en_GB

https://support.apple.com/en-gb/HT206587