Maybe add a "flap" of wood on the edge of one of the doors. You would have to open/close the doors accordingly, but you could put some weatherstriping to it and create a tight seal.

Just my $0.02