What audio output ports and playback features does the Olympus recorder have? E.g., 3.5mm (1/8"), RCA, or something else?
You will need to connect the Olympus line out to the line in on your PC and have the software to capture and save that audio to a file.
Then the file would, in turn, be copied to the flash drive either in its native format or converted to fit the playback requirements.