USB flash drive slow transfer speeds

Status
Not open for further replies.
I am trying to transfer my entire modded Fallout 4 to a Lexar S75 256 GB USB 3.0 flash drive.
That's about 58987 files with a total size of 124 GB. It started reasonably fast at over 30mb/s but still way slower than what USB 3.0 should be but it gradually slowed down to under 12 mb/s after just an hour and it's still getting slower...

This is the drive I got:
https://www.amazon.com/Lexar-JumpDrive-256GB-Flash-Drive/dp/B00S5V5PTC

my motherboard is Asus Z87k and the flash drive is inserted into the USB 3.0 port.
My OS is Windows 7 Home Premium 64bit
and the flash drive was formatted just before the transfer using the default window settings:
File system: exFat
Allocation unit size: 128 kb

The files are being transferred from a Samsung 850 Evo 500GB ssd

I guess my question is if this is normal and if there is something I can do to speed up the transfer speeds. I have heard usb flash drives have cache memory and if the cache is filled up the transfer speed would drop but is it normal for it to drop to around 12mb/s?


EDIT: the transfer speed has stopped slowing down and is not at a constant speed of around 12 mb/s
 
Solution
Actually, if your USB 3.0 thumb drive is running at a continuous 12mb/s after the initial burst fills the cache, and the drive begins to heat up (Which it WILL), then that is probably pretty normal. I've never had one even stay continuous at that high of a rate of speed. Usually they will even drop down into the kb/s after a while, and then go back up, and then drop down.

Much depends on the number of files, the SIZE of the files, since smaller files are going to transfer at much slower speeds than large files. It takes me about ten minutes or more just to transfer 4-8GB of music files to my 16GB USB 3.0 thumb drive when I update the songs I want on there.

I don't think you have a problem other than being too impatient, which is...
Actually, if your USB 3.0 thumb drive is running at a continuous 12mb/s after the initial burst fills the cache, and the drive begins to heat up (Which it WILL), then that is probably pretty normal. I've never had one even stay continuous at that high of a rate of speed. Usually they will even drop down into the kb/s after a while, and then go back up, and then drop down.

Much depends on the number of files, the SIZE of the files, since smaller files are going to transfer at much slower speeds than large files. It takes me about ten minutes or more just to transfer 4-8GB of music files to my 16GB USB 3.0 thumb drive when I update the songs I want on there.

I don't think you have a problem other than being too impatient, which is actually pretty normal.
 
Solution


haha I guess you are right.
so i guess the product description is pure bs
"Stores and transfers content faster with SuperSpeed USB 3.0 technology (up to 150MB/s read and 60MB/s write)"

hmm I have actually extra ssds would it be faster if I plug the ssds to USB3 port using an adapter?
 
Those are theoretical speeds. If you transfer ONE file that is 1GB, it MAY transfer at that speed. Otherwise, storage devices almost never transfer at the advertised speeds. There are too many other factors involved such as the file sizes, number of files, speed of the device being transferred to or from, whether the drive is constructed in such a way that it does not end up throttling from heat, etc.
 

If you scroll down to the user review photos at the Amazon link you gave, you will see your problem. The 4k write speeds for this drive are 0.5-0.6 MB/s. That's right, half a megabyte per second. The drive will work at or faster than the advertised speed if you're reading/writing sequential data (large files like movies). But absolutely sucks at small files like a Fallout 4 folder.

For this reason,I always tell people to ignore the sequential speeds and concentrate on the 4k speeds when picking a flash card, drive, or SSD. Unless the only thing you plan to use the drive for is movies or photos (i.e. use it in a camera), the 4k speeds will be much closer to the real-world speeds you experience. (Actually the 512k speeds were most representative, but CrystalDiskMark seems to have dropped that in favor of the useless sequential queued.)

Samsung flash media and the higher-end Sandisk flash media ("Extreme" and "Extreme Pro") are pretty much the only ones which consistently score well at 4k speeds. And even those are usually around 2-8 MB/s (which is still better than a hard drive - those only manage about 1 MB/s). Your Lexar is bad, but not as bad as some of the cheaper brands. Many of those get around 0.005 MB/s at 4k writes.

If this is for transferring or backing up the game, rather than playing it, you can zip your Fallout 4 folder into a single zip file. Because that'll be a large file, it will write at the Lexar's sequential write speed, which should be around 60-100 MB/s.
 


wow now i kinda feel stupid
I mean when I choose a SSD it's always the sequential speeds that I look at which is why all my ssds are Samsung 850 and 860 but I totally forgot about it when I bought the Lexar flash drives.
I do have samsung flash drives but they are only 128gb so not enough for storing the entire fo4 data folder

I am trying to reinstall Fallout4 because of the ctds I have been experiencing in certain areas.
I have tried everything from solving mod conflicts with FO4Edit by creating a master patch for all the plugins to testing by disabling most of the plugins but it didn't help so I finally decided to reinstall everything.
This is just for backup and for helping me when I reinstall the game and 300+ mods :D
 
Those are not bad choices for SSD, because they ALSO have generally faster random speeds at practically all queue depths than most other competing models. These days MOST SATA SSDs have pretty much nearly saturated the SATA bus so longevity might be a bigger determining factor when choosing an SSD, but for flash drives there are few competitors to Samsung and Sandisk although Crucial isn't usually far behind or is equal to both of them for most types of storage medium. Consider, Micron is Crucial, and Micron has been around for a very long time, since 1978, far longer than most the players in the game today.
 
I actually tested the transfer speeds by moving the same 124GB folder to a Samsung 860 1TB drive connected to the same USB 3.0 port using a SATA/USB3.0 adapter and I was surprised that the transfer speed reached 100+MB /s rather quickly and stayed there

If i remember correctly it only took 15-20 minutes compared to 5+ hours for the Lexar USB flash drive.
So my new question is
other than the higher cost is there a reason not to use SATA SSDs instead of USB flash drives for short term data storage? and what about long term? lets say 1-2 years. I know ssds have to be powered on for it to retain data but doesn't the same apply to USB flash drives?
well also considering the price on SSDs has dropped a lot lately it may be actually cheaper to buy a high quality sata SSD than a fast USB flash drive
 

Cost and size. You can get USB flash drives which are about the size of a wireless mouse dongle. And microSD cards are now as large as 400 GB.

and what about long term? lets say 1-2 years. I know ssds have to be powered on for it to retain data but doesn't the same apply to USB flash drives?
They are both NAND so will lose data after enough time. How long depends on the NAND used so there's no way to be sure. The only reason it's less of an issue on SSDs is because their wear-leveling algorithm occasionally rewrites data to other NAND cells to try to evenly distribute writes. The rewrite refreshes the charge in the NAND cell.

well also considering the price on SSDs has dropped a lot lately it may be actually cheaper to buy a high quality sata SSD than a fast USB flash drive
They are both NAND, so if the price of one drops, so will the price of the other. USB flash drive prices aren't dropping at the low end because they're already rock-bottom (32GB for $5). The higher capacity USB flash prices have dropped as much as SSDs (256 GB flash has dropped from about $80 to $45 in the last half year).
 


I actually looked into the costs of both the usb flash drives and SATA SSDs:

the same crappy Lexar 256gb flash drive is currently 44 USD on Amazon (I think i bought mine for 50 bucks from Office Depot)
https://www.amazon.com/Lexar-JumpDrive-256GB-Flash-Drive/dp/B00S5V5PTC

and the Samsung 860 EVO 250gb is 53 USD on Newegg:
https://www.newegg.com/Product/Product.aspx?Item=N82E16820147676

The difference is only 9 bucks! but as I mentioned above the Samsung ssd is so much faster when transferring large amount of data:

constant 100+ MB/s transfer speed with a sata/USB3.0 adapter
the Lexar managed 30mb/s the first few minutes but eventually down to 10-12mb/s
The average transfer speeds could be even lower than that considering the Lexar actually make pauses between each files... which is why the total time to transfer the entire Fallout 4 data folder was 5 hours

Of course there are better USB flash drives out there:
https://www.amazon.com/SanDisk-Ultra-256GB-Flash-SDCZ48-256G-U46/dp/B00YFI1A66
but its still a 44 dollar stick and even though it states: Read Speed up to 100 MB/s2
I highly doubt its transfer speeds will even be close to the Samsung 860EVO ssd

So yeah, I guess the lesson I have learned is that the prices on SSDs are so low now that it is possibly better to get a ssd as storage device than any of the usb flash drives out there.

Also anyone dare to buy this Chinese 18 dollar 1tb usb flash drive and check if its fake or not:
https://www.amazon.com/Pili-Dingtian-Flash-Capacity-Memory/dp/B07GNMYCYT/ref=sr_1_5?s=pc&ie=UTF8&qid=1544696828&sr=1-5&refinements=p_n_size_browse-bin%3A10285020011

Didn't know Amazon sells fake Chinese junk
 
You DO realize that pretty much 99% of all electronics devices are made in China, right? There are a small percentage made elsewhere, like Japan and South Korea, some very few products in the US and India, and an even smaller number of stragglers elsewhere, but overall the majority of every electronic product you buy has been built and probably assembled in China. Even a lot of stuff that says "Made in the USA" had ALL of the parts made in China and then was assembled here, which allows them to say that. There are a few exceptions, but very few.

So that drive is probably neither better nor worse than any other off brand product, but I'd agree, I wouldn't spend MY money on it without seeing at least one reputable professional review on that product. The fact that almost all of the customer reviews on Amazon, which I normally don't pay attention to unless they are all conclusively the same, say the product is crap, would really lead me to believe that seeking out a professional review is both unlikely to be successful AND is a waste of time.

 
Actually, most NAND (flash memory) is made in South Korea. I believe Samsung is the only manufacturer with a major NAND fab in China. Other countries where it's manufactured are Japan, Taiwan, and the U.S.

The "crappy Chinese flash" products are usually counterfeit (pretending to be made by a major manufacturer), and use tricks to report a higher capacity than the device actually contains. So they may stick 8 GB of NAND in it, but program it to report 256 GB. You can copy data to it and it'll write to it like it has 256 GB of capacity. But all that's happening is the new data is overwriting old data, which you'll find out when you try to read the data back. It's gotten so bad that I would never buy flash devices from eBay. And the only one I'll buy from Amazon is the Samsung Select (an Amazon-exclusive brand). Anything else I'd buy from a retail store, trusting their supply chain to keep out fakes. Plus I can just drop by and return it if it turns out to be fake.

I'd actually have to tip my hat at a Chinese brand selling a flash drive under their own name. Even if it's a crappy product, at least they're doing it under their own name instead of trying to trick you. That gives them an incentive to improve their product, and thus build up a good brand image.

Also be aware that we're entering a NAND oversupply period. The market transitions between NAND shortage and glut (oversupply). We've been in a shortage for nearly 2 years now, which led to prices holding steady and in some cases increasing. Demand has leveled off, and supply has overshot so we're seeing prices drop now as manufacturers try to clear out excess supply. So we're going to see dropping prices and price inversions (like new 256GB SSDs costing the same or less than older 256 GB USB flash drives) for the next few months. Usually these cycles take 1-3 years, though I've seen one last as short as 6 months. So if you need flash storage, now is a good time to buy. Although if you don't need it immediately, I'd wait until Spring in case prices drop some more.
 



ah yes of course. I know it says "made in china" on pretty 90% of the stuff that I own. From Samsung cellphone to Samsung ssds to the Lexar flash drive to some of the clothes that I wear but they are known brands.
I wouldn't call brands like Lenovo, Huawei junk but the unbelievably cheap flash drive being sold on Amazon with Chinese brand names, I know because I speak the language, are just scams and therefore should be labeled as junk



Well this is actually old, very old.
I remember when I was in Shanghai back in 2014 I saw 1 and 2TB usb flash memory and micro sd cards in a shop going for around 20 bucks and I just couldn't stop laughing because I knew back then there were no 1-2 tb micro sds. BUT it is a shame that Amazon allows shady individuals to sell well known fake products on their website
Sorry for the OT.

According to some sites the price on ssd will continue to fall into 2019 but that's what they said couple of months ago
 
The Nand might be made there, but you can be pretty sure that most of that Nand is shipped to China where they use Chinese made circuits, micro boards, enclosures and all the rest. The Nand is only as good as what it's installed on and what is around it. Which of course, we've seen time and time again when it comes to a variety of flavors of SSD with different hardware and controllers using the same Nand.
 
Status
Not open for further replies.