I believe that you cannot have information without memory. If you consider information as a set of instructions or even more simply 'data', something must store the data (memory) for it to exist. The storage medium is the memory. If the storage medium is a permanent integrated circuit which is set to operate to give certain outputs based on certain inputs the memory is the configuration of the circuit and the information is the output of the circuit.
If you change the configuration of the circuit so that the output no longer correlates with specific input 'the information' no longer exists in the output of that circuit. Some information may exist in the output of the changed circuit but it is not specifically 'the information'.