Double-check to make sure your folder has the correct option selected. Afterward, depending on the size of the video file, it should load the first frame of the video in a few seconds.
If that doesn't work, go to Folder Options > View. Near the bottom, check the box that says "Remember each folder's view settings."