Who controls the goods when documents are rejected?

Control follows the transport document, not the credit. If the bill of lading is consigned to the issuing bank's order and the bank holds the originals, it controls release; if the exporter holds them, the exporter does.