Hi Chris, many thanks for the very good video, as always. I see another possible way to solve the problem : Go to the wrench menu : -> SAVE DATA SET-UP -> SELECT FOLDER -> CREATE FOLDER. This will automatically create a new folder for the next picture you take and use it for all new pictures Works well on a X100V at least.
As soon as I read the title, I knew what the video was going to be about! This happened to me twice, but up until now, I didn't know why. It was really frustrating since the last shots where ones I was really proud of and I couldn't find them. I figured out how to get to my photos by connecting the camera to my MacBook after some tinkering and wanted to share this solution here, but sure enough, Professor Fuji knew about that already!
Against my better judgement, I decide to do some testing yesterday with my Fuji X-T3 and 2 Macs (2013 Intel Mac with MacOS 10.11 and a new M1 Mac Mini with OS 11.4) and an iPad Pro. Note: The issue was first reported on the DPreview forums on Linux with a Fuji X-T4. I don't have a Linux distro to test, and while I have both a Fuji X-T3 and a Canon, the latter is a DSLR and I didn’t care to shoot over 4096 photos for this test. Others report no issues with Canon files. The reason becomes clear later. Method: To replicate the issue, I set the camera to shutter speed 1/8000, ISO 160, electronic shutter, 20 frames/sec, 'normal' jpg only, kept the lens cap on, and taped the shutter down until it had shot some 5000 images or so. I created a new folder in the camera, switched to it, and repeated. They show in the camera. Connecting the camera with a USB cable and using Image Capture works, all images show and import. The difference is that the camera firmware reads the SD card. I transferred the SD card to the computer; on the M1 Mac Mini with a USB3 SD dongle, on the 2013 iMac with it's native SD slot as well as the USB dongle, and looked at the relevant image subfolders. Only 4096 images show in either folder on both computer and iPad. Same for putting SD card into a dongle for the iPad, only shows 4096. But copying more files into the folder via the Finder works, as well as creating a new folder and copying 5000 jpgs into it. Works fine, opens fine on the other Mac. MacOS has no issue reading and writing to and from the SD card. This, as someone else found, also reveals a simple workaround to show all the files. In conclusion: It's a Fuji firmware issue to do with how it writes the directory entries to the SD card, as the files are physically on the card still. Before they increased the folder file limit to 9999 images, the issue would have been masked. On the X-T3, that was in Firmware 3.20. I don’t know if the issue has existed since then and no-one noticed, or it is the more recent 4.10 or 4.11 update which broke their exFAT code. Interestingly the Linux kernel developers have already issued a patch to work around this issue between Linux exFAT and exFAT of “some camera company”. Guess who. https:/lore.kernel.org/linux-fsdevel/000001d779fd$4e12ca20$ea385e60$@samsung.com/T/ Since the issue is how Fuji’s firmware writes to the directory, a simple workaround is to force the directory entry to be updated. Plug in your SD card and navigate to the affected image folder. Adding a single file to the folder forces an update to the directory, and ALL the files will reappear!
This just happened to me this weekend! Thank you! I thought I was going crazy trying to locate about 10-20 images I shot on an "OLD" SD card (at least 9 years old). I wondered if it had anything to do with the "age" of the SD card since the new SD cards were able to perform flawless. I have now marked those OLD SD cards as my "P" for practice cards and will only use the brand new cards for paying clients. Glad the shots I took (the 10-20) images were not super important, but still having a technological answer really helps my anxiety. Thank you!
Haha this is a great video. The frustration feels totally valid! How interesting. I only use a 32GB card so I can't even hit >4096 but I'm a software engineer and this is definitely some kind of deep code bit/byte issue. I'll definitely look into it! I'd bet this is a limit to the number of files that macOS can read in any single directory on a mounted drive. I haven't looked at it, but is it possible to setup the foldering structure in-camera to limit the number of photos per folder to
Chris, out of curiosity have you tried / confirmed that this limitation exists when shooting a large number of photos on another platform? I think this may be related to the way that Fujifilm formats SD cards - I only have an X100V myself but I'd be curious if the issue exists with other platforms (Canon, Nikon, Sony, etc.) too. Would love to chat more 👍🏻
I looked into it. It's not the MacOS exFAT driver, it works fine. Linux just released a patch to their kernel to work around the bug in Fuji's firmware. It has to do with how it writes to the directory. A simple workaround is to force the directory to be updated by adding a single file to the affected directory via the Finder.
This should be my biggest problem. If you look hard enough you can find something wrong with many things. And you do a good job at looking for things. I do enjoy your videos. Very informative.
Switch from a Mac OS system to Windows system because of an obscure 4096 files on an SD card problem? Seriously? Knowing the problem exists you can always copy images 4097 and beyond onto a second card in-camera if you have a 2-card slot camera, like many Fuji models. I would buy a new camera before I would switch back to Windows.
I think it is not a single incident. I am cross platform user and I feel that Windows just give you customisable control of your hardware. Apple on the other side only give you a system default setting which limit a lot of functions UNLESS you dig deep into system coding. For dumb users Mac is an easy way out if you play by their rules. As an overall impression, the files/ folders control ( maybe also system resources management), windows is more user friendly.
Here's a workaround: on your Mac, just add one file to the DCIM/101_FUJI folder on your SD card. Just tested after shooting a time lapse of 4244 frames with my X-Pro3.
OSX will also count deleted photos as part of the 4096 photos. Say you've shot 4000 photos, connect to your mac, delete the photos (do not reformat the card), shoot 100 more photos... the 4 last photos won't be visible. I've just returned from holiday abroad where I took a bunch of photos with my Fujifilm XT-1. When I connected the SD card to my Mac I noticed pictures missing. Strange I thought, so I tried to eject and insert into my camera. Now the camera said "Read error". Minor panic ensues, but luckily I found your video. I only have around 1000 photos on the SD card, yet only about 300 were visible on my Macbook Pro. So THANK YOU so much for this video!
A simple workaround while we wait for Fujifilm to fix their firmware is to open the directory on the card with Finder and click on one of the jpgs - this will show the jpg image in Preview and, as a by-product, fix the directory. All files will then be visible.
Could this be a folder limit rather than a card limit? At least on an X-T3 there's Set up -> Save Data Setup -> Select Folder -> Create Folder to send images into a new folder.
Hi, Great video. Some questions / comments: 1. This is about the number of images in a single directory, right? Not the images on the card, but in a single folder. 2. Another workaround would be remove some images from the SD card after you copied them to your computer, I think? So that the total number is below 4096 again, you should be able to see the remaining images I believe. 3. If you use a windows emulator on the Mac like Parallels, can they see all the files? 4. Have you tried reading the SD card with 4,111 images on a Linux computer? That's the same old UNIX foundations but I suspect it will work... putting the issue squarely in Apple's court. 5. Various editing software I use works more reliably on my Mac than on my Windows computer. Affinity Photo crashes a lot on Windows for instance, but not on the Mac. Can't quite chuck the Mac out of the window for photo editing...!
Chris, thanks for the video. Watching your Fuji related stuff as I'm just about to make the jump from Canon. I've had similar issues with "missing" images on my Canon 6D mk I with two different 32gb SD cards. It usually happens when I come close to maxing out the card (so obviously nowhere near the 4111 you're able to shoot on the 128gb card). When I access the card on my Mac I'm unable to view the last dozen or so shots. Always found it annoying, don't know if it's related, but glad someone made a video about it!
Thank you so much. I was next to tears thinking I'd just wasted hours taking pictures that were not going to be accessible. I was able to import with a USB from my camera to my Mac, like you said.
I used to edit on a mac, but I switched to PC for all of my workflow years ago. I don't blame anyone form jumping platforms too or from either. Just depends on what you're comfortable with. Most people wont know the difference honestly, they'll just perceive the platform they prefer is better. I personally switched because it saved space at the time, and now I just don't see the point in buying a new mac just to keep up with my PC. At the end of the day use the platform you like, and come to terms with its limitations. Keep up the amazing content!
With Nikon can create multiple folders in camera on same memory card to separate photos. Not familiar enough with other brands if that's also possible but would guess it is an option. Have you tried going to the limit in one folder then create a second folder to continue shooting more if mac will recognize the photos in the separate folders? My thought is mac might recognize the additionally photos in other folders if under the 4096 limit.
I've done some testing: Yes on Fuji you can create new folders and switch to them, and yes that works as a workaround until Fuji fixes their firmware. MacOS itself has no issue with it's exFAT driver, reading or writing. Also importing via cable to the camera works fine.
Could you download the 4,096 photos that the laptop can see, delete 100 of the photos that were downloaded from the card and then download the photos that did not originally appear?
Hi Chris. Thank you for this video. I had the same problem, and appreciate your research. I have no understanding that Apple has not solved this. I am also very close to switch back to PCs again. Apple is just falling behind. I also moved from 128 SD cards to 64 SD cards. Makes sense.
Great video! With my Fuji XT-4 I have never shot that many images on the single SD card. But with Canon R6, which I use for wedding photography, camera creates new folder on the SD card when it passes certain amount of images, I am not sure how many images, but I am sure it’s more than 4k images. At some weddings I shoot 10k images, did not loose one single image with Canon. I had all sorts of Canon cameras, and it always created new folder and I never had problem with Canon and Mac. Currently I own M1 Mac, no problem with Canon cameras as well.
Chris do you still use photo mechanic for culling through your SD cards, in search for the best shots? Have you found anything recent that makes your work flow easy or is photo mechanic still going well for you?
I have two X-T1s and they both automatically create a new folder every 1000 photos. So if I'm shooting JPEG+RAW, that's at most 2,000 files per folder. It remembers the last folder name it's created even when I delete the photos off the card or put a different card in. There is probably a setting to configure this behaviour.
i write from Italy with Google translate a few days ago I concluded a trip to Europe I brought a Nikon d7500 and a Fuji XS 10 Nikon creates a new folder on the SD card every 1000 photos So there are no problems in my iMac Fuji does not create a new folder. my iMac has problems over 8100 photos Thanks for the warning I have used Fuji for the first time this long
ExFat file system, developed for winCe device (a primitive tablet of last century). In the time was upgraded but keep a lots of limits, I think is a limits of file numbers for folder, in that period memory was measured in mega not in giga, 4096 seems giganorm Try to do a new folder in sd card after 4000 photo and see if is a problem.
I use 8 different cards 64 Gb to 128 Gb, always one as backup inside the camera. Sure it‘s not normal to shot >4000 pics on one card, but it might happen.
I read the original thread. The guy shot 6000 photos for a wedding! Ok, he shot JPG and RAW, hence 'only' 3000 photos on the one camera. I can see that for a full day for a large wedding. In the meantime while you wait for a Fuji firmware fix, you can stop and create a new folder within the camera and switch to it, as it only affects individual folder. I did a test, it works. Also, yo ucan connect the camera via USB and import with Image Capture. I haven't tried importing direct to Lightroom, funnily enough.
Hi Chris, do you have any video to talk about black and white photography and advantage of having a monochrome sensor (like Leica q2) versus rgb sensor and using film simulation filter (like Fujifilm cameras) for b&w instead?
Great to know about this. You didn’t cover if you can see those files by deleting some of the earlier ones… if you delete the first 15files will the remaining files you shot show up?
I tested that; it doesn't change anything. Connecting the camera via USB you can see and import everything, and you can read and write as many files as you like to the SD card via the Finder, but the hidden files remain hidden in the Finder. Hopefully Fuji will release a fix to their firmware soon for those affected. It appears to have something to do with how the firmware writes the directory, as the files are physically still there. I don't shoot anywhere near that many photos in a day, so it doesn't concern me. Edit: Someone found a simple workaround! Plug in your SD card and navigate to the affected image folder. Since the issue is how the Fuji firmware writes to the card directory, adding a single file to the folder forces an update to the directory, and ALL the files reappear!
I have visited west Germany last year and been around 15 Museums and made Albums and saved in my.Samsung Micro SD Card and many of them dissapeared just like that. And I have opened Google Drive and I have found some pictures of 5 different museums that I have visited and I have downloaded them to my computer through Google drive and they are not visible in my phone but however they are visible on Google Drive. Somehow 60-70 % of my Museum Albums dissapeared.
Not correct in the case of Nikon. When Nikon cameras reach a certain number of images, they create another folder & continue writing to that folder & when that reaches its limit (card size permitting) it creates another folder until the card's limit is reached. I can't recall the number of files per folder but as a Mac user & Nikon shooter, I have never come across the problem.
@pal2tech, wonder if the problem goes away if you throw money at it? Like, for instance, do backup on a Gnarbox and then copy/transfer the images from the Gnar to the computer. I don’t have a Gnarbox, but will consider getting one if it can read those SD cards.
always flip the little lock-tab to locked position on a sd card, before reading it from a computer- you don’t want the computer to write to the card off-hand
first of all, thank you for talking about this. here is my case, I got XT4, and yes all of the pictures above 4096 could not be read on my Mac. but not it does not only do not show on the mac but also on the camera. did I just lose all of the pictures? please help,,
Well I stopped using Mac OS a long time now. I think they're great machines but I find that I'm always getting connectivity issues with them. Also their laptops lack so many ports that I really cannot stick with their machines for this reason.
Coming to think of it I shot one of our local mountains one day recently I was shooting using 3 different sims, well well I put my sim card into a windows 10 computer. I transferred my files and I noticed that some was missing, I put that car back into the pc and the same thing files missing. I did not want to lose the files I had so in the end I just formatted the card and lost them, I know I had these files as I said I was trying the 3 different sims. I was so annoyed that I could not see them but could not do anything about it.
Are you sure this is UNIX related and not FAT12 related? Or the implementation of reading FAT filesystems by OSX? If you would try to put more than 4096 files in a normal folder on your hard drive, does that also give an error?
Chris… How many of your subscribers are stupid enough to put 4000 images on a single card? Every Competent photographer I know goes to great lengths to avoid data loss due to cards or hard drive failures. With this in mind why in the world would anyone put that many photos on a single card. I don’t deny the facts that you present, but come on now . You should re-edit the beginning of your video and make clear that this is malpractice to commit everything to one card period. Love your channel and thank you for all your hard work!
I experienced this issue as well. I could see the photos on the camera, but not on my mac. Plugged the SD card into my macbook, and when inserting it back into my X100V all photos above 4096 was gone. I can see the missing photos when running Disk Drill, but haven't successfully recovered them yet. Any recommendations on how to do so, without having to use Disk Drill, would be warmly received.
I am having the same problems, but more general reading issues on the San disk sd cards. I've already bought three and the issue continues. No problem on pc tho
What if this is happening to me but I only have 500 photos on my SD card and the last 200 are not showing up? My other SD card imported the 1800 with no issues.
What is you move some of the pics from the SD card to the local HD? this way yuo go belowe 4096 and the rest of the invisible files shoul be be back visible
So many photographers make up for lack of skill by machine gunning images. No sympathy! The only justifiable reason to have that many images on a single card is time lapse photography.
Why would anyone have that amount of images on one card, apart from time lapse as you said. My largest card is 16gb and I have never filled it and I only shoot RAW.
Not having an SD card slot is the only issue with the M1 Mac Mini for me, a USB3 SD dongle works just fine. I also have a Thunderbolt dock from my previous Mac, which is a great help. No issues reading or writing to SD cards either. Testing shows the problem is the recent Fuji firmware update. I don't shoot timelapse or spray and pray, so it won't actually affect me anyway. Once I've imported and backed up my images, I reformat the SD card in the camera, as I don't want duplicates floating around.
Legit argument, people pay Apple for a premium product with a premium price. This shouldn't be something you have to be aware of or manage or juggle with a premium priced product.
Something pretty stange : I copied 4097 empty files to an SD card from a Windows machine, I can read them all from my Mac I copied 4097 empty files to a TEST folder on the same SD, and I can also read them all from my Mac I'm a little bit disapointed :-D
I have similar situation on PC now. I shot 912 photos yesterday (sony a7r3). I had 2 cards in camera. Sandisk and Sony. Then I came back home and checked card in my PC and it shows only 511 photos. So i inserted second card and go back to adobe bridge and all photos was in. But on second day i run PC again and this second card start showing only 511 photos as well on adobe bridge and explorer. So i check it on my laptop and the same... only 511 photos! So I get back to my PC again and run lightroom and it show all 912 photos. What is happening? I dont know...
Another topic for you would be the limit that is posed on how long videos could be imported by image capture….tried to help my daughter with a schoolproject and the films were always to short. Drag and dropping the files from the sd card helped. Then there is the issue of not being able to read any of my lexar cards used in my gfx cameras on a mac….only solution is to use the camera as a cardreader.
Same here. I always clear my cards after importing and backing up, as SD cards are not longterm storage and I don't want duplicates floating around. Having old files on the card slows importing next time around. Besides, I have a 645Gb card in both slots set up sequentially, so it overflows onto a new card. For professional wedding and event photographers, they would probably like to have the space and use the 2nd slot for backup. Neither have I ever shot that many photos in a day, even for a full festival going into the evening. I consider my shots and only do short bursts to capture action or expressions. The issue is a Fuji firmware issue, hopefully they will fix soon for those affected. A workaround is to create a new folder in camera snd switch to it after shooting for a few hours, as the bug only affects individual folders.
@@msandersen usually I shoot redundant, just in case a card gets erased. I took a trip to Disneyland recently with my kids and had some once in a lifetime shots. Shortly after, my wife needed to film something for work, but wasn’t used to my X-T4. She tried erasing the footage and ended up erasing the entire card. Lucky for me, I had a second card and I have it set up where you have to go to each card to erase the photos you want. This saved me all my priceless photos of my kids. Since I didn’t have the chance to backup the photos right away, I would have been really upset if I lost everything. On a normal day, I usually backup my photos and put my SD card away and put in a new card. I personally haven’t lost and SD card pictures yet in the last 8 years, yet I’ve had a reliable flash storage not be so reliable and take a dump on me, which I know wasn’t overused and was taken care of properly. If my SDs weren’t working properly on top of this, I would have sent out everything to get restored and possibly saved if needed.
Hello there! I have transferred all the images from the SD on my Alpha 6000 to a Win PC's Folder I have then upgraded my SD Card on my Alpha 6000 and restore all the images but the camera won't show them It will show only the new pictures I have taken How do I make my Sony Alpha show the photos again? Thanks a lot in advance
found this by accident on my 2021 M1, 16gb RAM Mac Mini, using 128gb SD card same as yours 🤨 Thought it was a faulty SD reader Mac also seems to have an issue with previewing compressed RAF files in Photos ... plenty of creatives use Mac, so 🤬?
Yes, neither MacOS nor iOS supports Compressed RAF (Fuji uses a proprietary compression). I keep hoping they will. The specs of the machine, whether Intel or M1, or the size of the SD card above 32Gb matters in this issue. The issue is Fuji's exFAT firmware driver which seems to not handle anything above 12-bit directory entries properly (4096 files in any one directory). The files are still there, just not visible if you plug in the SD card into a Mac, iOS or Linux machine. I haven't heard about Android, but it is probably affected as well.
I move my pictures from my SD card to my PC and realized I want to keep sending them to my phone so I can move them back and now my camera and my phone don’t recognize any images is there a solution
Somewhat separate issue but I had just lost 250ish photos after opening files and putting them into different folders. Separated Jpg from Raw files, opened 6 in Lightroom, then they disappeared. Can't find them anywhere after originally being able to find them. Afraid to eject my sd card. Any thoughts?
In your video you show all the images you shot on your Fuji to one folder on the card But - on all my cameras it states that no more than 999 files can be stored in a folder. If you try to - then a new folder is automatically created. So - perhaps there is an issue - but camera makers know this limitation in the agreed camera/card/file standard and prevent the camera from creating the problem If, however, the user manually copies all the images into a single folder - then there is a problem as you have by-passed the safety mechanism So Chris, how did you end up with all the images in a single folder on the card as shown in the video? Brian
A Fuji firmware to certain cameras increased the limit to 9999 files; in X-T3 it was firmware 3.20. I don't know when this particular bug was introduced, if it was then and nobody noticed until now, or there was a bug in the recent 4.10 or 4.11 update. Either way, someone pointed out an interesting fix: Since the problem is how the camera writes the directory entry, simply adding a single image file to the affected folder forces an update to the directory, and all your files reappear.
@@msandersen Martin - thanks for the info I have checked the 'Design rule for Camera File system' which specifies the file system for camera cards and it states that there can be a maximum of 9999 files in a folder and a maximum of 999 folders. Perhaps different camera makers apply slightly different rules. There is also the issue that different size cards/cameras may format cards using different settings. Anyway - an interesting issue.
Hi,I have a problem in my fijifilm camera, I accidentally deleted the wonderful photos, I tried to restore,but I couldn't.. Do you have any ideas to do that? I watch most of the videos but none of them are successful 🙁
On my X-T200, and my daughter's X-A3, the camera has created a new folder under the DCIM folder for every 1000 shots, in your example, that would have folders 100_FUJI to 104_FUJI, if shooting JPEG only or raw only, then you have a base of 1000 files per folder, with JPEG+raw, 2000 files per folder, to exceed 4096 files per folder, you'd need to do a lot of in-camera edits. In both cameras, the default lifetime sequence numbering mode is active, I'm not sure if this behaviour changes if you change the sequence numbering settings. Does the X-T4 not use subfolders normally? Or does it just drop that when changing numbering settings?
Hi Chris, I came to your vid having the issue with the 4096 pictures. I do not own a Microsoft PC, what happens if I remove old pictures from my SD card. Will it show my newer pictures then? I'm quite hesitant to plug the SD card in my Mac and delete pictures and then find out I lost more than I intended to delete.
I am sure Apple will fix this in a future version of OSX or iOS or next Mac, MacBook. It's funny that Apple used to market their products as "it just works". I used both Windows and Mac. Nice to know I can work around it by using a Windows machine.
Such an intriguing issue! I didn't want to sprain my trigger finger ;) so I tried an alternate way to reproduce the problem (and maybe find some workarounds). I formatted a 128G Sandisk SD card in my X-Pro3 and took one JPEG photo. Then, on my Macbook Pro 2018 (running Big Sur) I created 4100 copies of it onto the same directory. Guess what, no problems. I took some more shots onto the same card and put it back into my Mac. 4108 photos, all visible in Finder in one single folder, no problems. Copying all those files was a bit slow, so to test with more files, I created some 8000 empty files onto another SD card (64G Kingston). Finder saw all 8000+ files there. Do the files actually need to be created in camera to cause trouble? And why would that matter, if this is a Mac problem?
Yes, I've done testing on 2 Macs (2013 Intel Mac and new M1 Mac) and an iPad. I set the camera to shutter speed 1/8000, ISO 160, electronic shutter, 20 frames/sec, 'normal' jpg only, kept the lens cap on, and taped the shutter down until it had shot some 5000 images or so. I create a new folder in the camera and switched to it, and repeated. They show in the camera. Long story short, connecting the SD card to either device only shows 4096 files in each folder; if you shoot RAW+jpg, that's 2048 images in each format. MacOS (same for Linux btw) can read and write any number of files to the SD card without issue, including the affected folders that only show 4096 shots. Adding files to the folder shows all the new files, including the original 4096, but never the 'hidden' ones. Removing files doesn't change anything. Basically the issue was introduced in a recent Fuji firmware update where it now allows up to 9999 files in a folder, up from 999, and hence exposing the bug in their firmware which could have been there all along. Edit: Someone found a simple workaround! Plug in your SD card and navigate to the affected image folder. Since the issue is how the Fuji firmware writes to the card directory, adding a single file to the folder forces an update to the directory, and ALL the files reappear!
In other Unix systems it issue doesn't occured. Soo its only apple things. 🧐 This is most likely due to the file system used by Apple and the address mapping in that file system.
@@msandersen 4 Gb is actually 4096 Mega bytes... 4294967296 bytec. And 4096 and 4 files - photos to be precise - are unlikely to take up only 4096 Mb of memory, so this analogy makes rather little sense.
I have used and supported (worked on or around) windows for so long I can't imagine using a different OS. Not a mac hater just can't understand some of the weird limitations they have.
ExFat (Microsoft creation) was in time upgraded and changed, but not all avaible, like ntfs file system. This kind of problems born also with many cinema camera, for this reason many cinema camera allow you to format in hfs+. Exafat had lots of weakness
No, that doesn't 'unhide' the hidden files. Connecting the camera via USB and importing with Image Capture works fine. The issue is the recent Fuji firmware.
Thanks Chris, and I agree on Apple. Ironically I have my 12 year old Lenovo Thinkpad Carbon for the same reason. Apple does not like to play nice. Whenever I lose something on my iMac, (my Canon scanner, my Garmin watch and nav as a few examples) my older PC is ready to go. And let's not forget Apple Aperture.
That goes for any computer; technology marches on, hardware, plugs, interfaces and protocols change all the time, see for instance USB over the past few years, and the mess that came before. New PCs with current Windows likely won't be able to connect those devices either. DLL Hell. All Windows users have had to deal with it. Good luck finding a drive that will work on a modern operating system. And Microsoft has abandoned plenty of software itself. People who rely on Microsoft Office have to keep an old computer with an old copy of Office around if they want to read old archived documents, as they drop support for older files occasionally. It's a big issue for governments around the world who are required by law to keep documents for 70 years or similar, depending on country.
Same. Intel Mac or M1 Mac, old or new OS. Even iOS. It only happens if you've updated your Fuji firmware. MacOS has no issue with it's exFAT drivers, it reads and writes fine to the card. Basically in the new firmware, it allows 9999 photos in a folder, but something about how their exFAT driver writes the directory means only the first 4096 files in any given folder will show when plugging in the SD card, whether using a Mac or Linux. You can use the Finder to add or remove as many files as you like to the affected folders, the hidden files remain hidden, while any newly added files show up and open. Plugging the camera in via USB works, all images show and imports.
Taking over 4096 pictures in one take/folder/shoot..? Then it’s a work flow problem if you ask me😁 And switching from Mac too Windows! just for this!?? I Love your videos and knowledge, but no I’m a bit disappointed! Thanks for the info, I would NEWER! experienced it my self, with my work flow..😁👍
Just to be fair: The original post he refers to was a wedding photographer doing a whole-day shoot, shooting around 3000 photos ion both JPG and RAW, hence 6000 photos. Still a LOT of photos, and even in a full day to late evening Festival shoot have I ever gone near that. It's not an issue that affects me personally, and it can be worked around until Fuji fixes their firmware. Maybe the wedding had a lot of guests, and each had to have a photo...
Hi Chris, many thanks for the very good video, as always.
I see another possible way to solve the problem :
Go to the wrench menu :
-> SAVE DATA SET-UP
-> SELECT FOLDER
-> CREATE FOLDER.
This will automatically create a new folder for the next picture you take and use it for all new pictures
Works well on a X100V at least.
As soon as I read the title, I knew what the video was going to be about!
This happened to me twice, but up until now, I didn't know why.
It was really frustrating since the last shots where ones I was really proud of and I couldn't find them.
I figured out how to get to my photos by connecting the camera to my MacBook after some tinkering and wanted to share this solution here, but sure enough, Professor Fuji knew about that already!
Against my better judgement, I decide to do some testing yesterday with my Fuji X-T3 and 2 Macs (2013 Intel Mac with MacOS 10.11 and a new M1 Mac Mini with OS 11.4) and an iPad Pro.
Note: The issue was first reported on the DPreview forums on Linux with a Fuji X-T4. I don't have a Linux distro to test, and while I have both a Fuji X-T3 and a Canon, the latter is a DSLR and I didn’t care to shoot over 4096 photos for this test. Others report no issues with Canon files. The reason becomes clear later.
Method:
To replicate the issue, I set the camera to shutter speed 1/8000, ISO 160, electronic shutter, 20 frames/sec, 'normal' jpg only, kept the lens cap on, and taped the shutter down until it had shot some 5000 images or so. I created a new folder in the camera, switched to it, and repeated. They show in the camera. Connecting the camera with a USB cable and using Image Capture works, all images show and import. The difference is that the camera firmware reads the SD card.
I transferred the SD card to the computer; on the M1 Mac Mini with a USB3 SD dongle, on the 2013 iMac with it's native SD slot as well as the USB dongle, and looked at the relevant image subfolders. Only 4096 images show in either folder on both computer and iPad. Same for putting SD card into a dongle for the iPad, only shows 4096.
But copying more files into the folder via the Finder works, as well as creating a new folder and copying 5000 jpgs into it. Works fine, opens fine on the other Mac. MacOS has no issue reading and writing to and from the SD card.
This, as someone else found, also reveals a simple workaround to show all the files.
In conclusion: It's a Fuji firmware issue to do with how it writes the directory entries to the SD card, as the files are physically on the card still. Before they increased the folder file limit to 9999 images, the issue would have been masked. On the X-T3, that was in Firmware 3.20. I don’t know if the issue has existed since then and no-one noticed, or it is the more recent 4.10 or 4.11 update which broke their exFAT code.
Interestingly the Linux kernel developers have already issued a patch to work around this issue between Linux exFAT and exFAT of “some camera company”. Guess who.
https:/lore.kernel.org/linux-fsdevel/000001d779fd$4e12ca20$ea385e60$@samsung.com/T/
Since the issue is how Fuji’s firmware writes to the directory, a simple workaround is to force the directory entry to be updated. Plug in your SD card and navigate to the affected image folder. Adding a single file to the folder forces an update to the directory, and ALL the files will reappear!
This just happened to me this weekend! Thank you! I thought I was going crazy trying to locate about 10-20 images I shot on an "OLD" SD card (at least 9 years old). I wondered if it had anything to do with the "age" of the SD card since the new SD cards were able to perform flawless. I have now marked those OLD SD cards as my "P" for practice cards and will only use the brand new cards for paying clients. Glad the shots I took (the 10-20) images were not super important, but still having a technological answer really helps my anxiety. Thank you!
Interesting, I wonder if Apple was not happy with the photos of yourself and just deleted them ! Computers are pretty damn smart Chris.
Haha this is a great video. The frustration feels totally valid! How interesting. I only use a 32GB card so I can't even hit >4096 but I'm a software engineer and this is definitely some kind of deep code bit/byte issue. I'll definitely look into it! I'd bet this is a limit to the number of files that macOS can read in any single directory on a mounted drive. I haven't looked at it, but is it possible to setup the foldering structure in-camera to limit the number of photos per folder to
Chris, out of curiosity have you tried / confirmed that this limitation exists when shooting a large number of photos on another platform? I think this may be related to the way that Fujifilm formats SD cards - I only have an X100V myself but I'd be curious if the issue exists with other platforms (Canon, Nikon, Sony, etc.) too. Would love to chat more 👍🏻
I looked into it. It's not the MacOS exFAT driver, it works fine. Linux just released a patch to their kernel to work around the bug in Fuji's firmware. It has to do with how it writes to the directory. A simple workaround is to force the directory to be updated by adding a single file to the affected directory via the Finder.
This should be my biggest problem. If you look hard enough you can find something wrong with many things. And you do a good job at looking for things. I do enjoy your videos. Very informative.
Switch from a Mac OS system to Windows system because of an obscure 4096 files on an SD card problem? Seriously?
Knowing the problem exists you can always copy images 4097 and beyond onto a second card in-camera if you have a 2-card slot camera, like many Fuji models. I would buy a new camera before I would switch back to Windows.
I think it is not a single incident. I am cross platform user and I feel that Windows just give you customisable control of your hardware. Apple on the other side only give you a system default setting which limit a lot of functions UNLESS you dig deep into system coding. For dumb users Mac is an easy way out if you play by their rules.
As an overall impression, the files/ folders control ( maybe also system resources management), windows is more user friendly.
Have you tried copying over the first 100 or so files, deleting them from the SD card, *then* getting the remainder in full?
Here's a workaround: on your Mac, just add one file to the DCIM/101_FUJI folder on your SD card. Just tested after shooting a time lapse of 4244 frames with my X-Pro3.
OSX will also count deleted photos as part of the 4096 photos. Say you've shot 4000 photos, connect to your mac, delete the photos (do not reformat the card), shoot 100 more photos... the 4 last photos won't be visible.
I've just returned from holiday abroad where I took a bunch of photos with my Fujifilm XT-1. When I connected the SD card to my Mac I noticed pictures missing. Strange I thought, so I tried to eject and insert into my camera. Now the camera said "Read error". Minor panic ensues, but luckily I found your video. I only have around 1000 photos on the SD card, yet only about 300 were visible on my Macbook Pro. So THANK YOU so much for this video!
A simple workaround while we wait for Fujifilm to fix their firmware is to open the directory on the card with Finder and click on one of the jpgs - this will show the jpg image in Preview and, as a by-product, fix the directory. All files will then be visible.
Could this be a folder limit rather than a card limit? At least on an X-T3 there's Set up -> Save Data Setup -> Select Folder -> Create Folder to send images into a new folder.
I smiled when you called out apple company. Excellent video once again!
Hi,
Great video.
Some questions / comments:
1. This is about the number of images in a single directory, right? Not the images on the card, but in a single folder.
2. Another workaround would be remove some images from the SD card after you copied them to your computer, I think? So that the total number is below 4096 again, you should be able to see the remaining images I believe.
3. If you use a windows emulator on the Mac like Parallels, can they see all the files?
4. Have you tried reading the SD card with 4,111 images on a Linux computer? That's the same old UNIX foundations but I suspect it will work... putting the issue squarely in Apple's court.
5. Various editing software I use works more reliably on my Mac than on my Windows computer. Affinity Photo crashes a lot on Windows for instance, but not on the Mac.
Can't quite chuck the Mac out of the window for photo editing...!
Chris, thanks for the video. Watching your Fuji related stuff as I'm just about to make the jump from Canon. I've had similar issues with "missing" images on my Canon 6D mk I with two different 32gb SD cards. It usually happens when I come close to maxing out the card (so obviously nowhere near the 4111 you're able to shoot on the 128gb card). When I access the card on my Mac I'm unable to view the last dozen or so shots. Always found it annoying, don't know if it's related, but glad someone made a video about it!
Different issue. This is a Fuji firmware bug in the latest update, affecting Mac and Linux.
Thank you so much. I was next to tears thinking I'd just wasted hours taking pictures that were not going to be accessible. I was able to import with a USB from my camera to my Mac, like you said.
Very helpful and entertaining Chris. Thanks!
You can also copy from the sd to your Mac on the command line. I know. Not what you wanted to hear but it worked for me
Honestly where would I be without you. thank you
Thanks, this explains why my time-lapses were shorter than expected.
I used to edit on a mac, but I switched to PC for all of my workflow years ago. I don't blame anyone form jumping platforms too or from either. Just depends on what you're comfortable with. Most people wont know the difference honestly, they'll just perceive the platform they prefer is better. I personally switched because it saved space at the time, and now I just don't see the point in buying a new mac just to keep up with my PC. At the end of the day use the platform you like, and come to terms with its limitations. Keep up the amazing content!
With Nikon can create multiple folders in camera on same memory card to separate photos. Not familiar enough with other brands if that's also possible but would guess it is an option. Have you tried going to the limit in one folder then create a second folder to continue shooting more if mac will recognize the photos in the separate folders? My thought is mac might recognize the additionally photos in other folders if under the 4096 limit.
I've done some testing: Yes on Fuji you can create new folders and switch to them, and yes that works as a workaround until Fuji fixes their firmware. MacOS itself has no issue with it's exFAT driver, reading or writing. Also importing via cable to the camera works fine.
Phew, I thought it was only me. You are awesome! Love your videos pal. Keep it up:)
Could you download the 4,096 photos that the laptop can see, delete 100 of the photos that were downloaded from the card and then download the photos that did not originally appear?
@@pal2tech 😂😂
That was exactly my first thought when looking for a solution to the problem.
If it's a directory issue you may be able to move some photos to a newfolder, unmount the SD and reinsert.
@@dshaf7 Yes, that would work.
Hi Chris. Thank you for this video. I had the same problem, and appreciate your research. I have no understanding that Apple has not solved this. I am also very close to switch back to PCs again. Apple is just falling behind. I also moved from 128 SD cards to 64 SD cards. Makes sense.
How about making a new file folder on camera?
Great video! With my Fuji XT-4 I have never shot that many images on the single SD card. But with Canon R6, which I use for wedding photography, camera creates new folder on the SD card when it passes certain amount of images, I am not sure how many images, but I am sure it’s more than 4k images. At some weddings I shoot 10k images, did not loose one single image with Canon. I had all sorts of Canon cameras, and it always created new folder and I never had problem with Canon and Mac. Currently I own M1 Mac, no problem with Canon cameras as well.
What if you cut the first 100 photos and paste them do the others show up
Great channel. I like it a lot, probably the best one.
Chris do you still use photo mechanic for culling through your SD cards, in search for the best shots? Have you found anything recent that makes your work flow easy or is photo mechanic still going well for you?
@@pal2tech hahah! Awesome thank you
I have two X-T1s and they both automatically create a new folder every 1000 photos. So if I'm shooting JPEG+RAW, that's at most 2,000 files per folder.
It remembers the last folder name it's created even when I delete the photos off the card or put a different card in.
There is probably a setting to configure this behaviour.
The 1000 file limit only applies to older Fujifilm cameras - the limit was lifted with a firmware release on the X-T3
i write from Italy
with Google translate
a few days ago I concluded a trip to Europe
I brought a Nikon d7500 and a Fuji XS 10
Nikon creates a new folder on the SD card every 1000 photos
So there are no problems in my iMac
Fuji does not create a new folder.
my iMac has problems over 8100 photos
Thanks for the warning
I have used Fuji for the first time this long
Thank you for making this video I was going crazy for a Min there!!!
ExFat file system, developed for winCe device (a primitive tablet of last century). In the time was upgraded but keep a lots of limits, I think is a limits of file numbers for folder, in that period memory was measured in mega not in giga, 4096 seems giganorm
Try to do a new folder in sd card after 4000 photo and see if is a problem.
Wow, my name uo in lights! Thanks Chris!! I was my honor given all that you have given to us!
Thanks for the video! I'm glad I always buy 64 GB cards. 4096 images won't fit on my cards even when using my low-resolution Canon R6.
Thx for sharing this issue, everyone who shoots weddings should know and be aware of this problem.
If you take over 4000 pictures to one SD card in a wedding, you should start doing something with your work flow..
And planning..
I use 8 different cards 64 Gb to 128 Gb, always one as backup inside the camera. Sure it‘s not normal to shot >4000 pics on one card, but it might happen.
I read the original thread. The guy shot 6000 photos for a wedding! Ok, he shot JPG and RAW, hence 'only' 3000 photos on the one camera. I can see that for a full day for a large wedding.
In the meantime while you wait for a Fuji firmware fix, you can stop and create a new folder within the camera and switch to it, as it only affects individual folder. I did a test, it works. Also, yo ucan connect the camera via USB and import with Image Capture. I haven't tried importing direct to Lightroom, funnily enough.
Thanks for this, Chris!
Hi Chris, do you have any video to talk about black and white photography and advantage of having a monochrome sensor (like Leica q2) versus rgb sensor and using film simulation filter (like Fujifilm cameras) for b&w instead?
Great to know about this. You didn’t cover if you can see those files by deleting some of the earlier ones… if you delete the first 15files will the remaining files you shot show up?
I tested that; it doesn't change anything. Connecting the camera via USB you can see and import everything, and you can read and write as many files as you like to the SD card via the Finder, but the hidden files remain hidden in the Finder. Hopefully Fuji will release a fix to their firmware soon for those affected. It appears to have something to do with how the firmware writes the directory, as the files are physically still there. I don't shoot anywhere near that many photos in a day, so it doesn't concern me.
Edit: Someone found a simple workaround! Plug in your SD card and navigate to the affected image folder. Since the issue is how the Fuji firmware writes to the card directory, adding a single file to the folder forces an update to the directory, and ALL the files reappear!
Why am I watching this video? I’m windows user. Anyway, I just like to watch this channel
well i hope you do convert to windows it would make following your tutorials as well as other contributers to youtube
I have visited west Germany last year and been around 15 Museums and made Albums and saved in my.Samsung Micro SD Card and many of them dissapeared just like that. And I have opened Google Drive and I have found some pictures of 5 different museums that I have visited and I have downloaded them to my computer through Google drive and they are not visible in my phone but however they are visible on Google Drive. Somehow 60-70 % of my Museum Albums dissapeared.
I see Fujifilm are finally implementing a workaround
Not correct in the case of Nikon. When Nikon cameras reach a certain number of images, they create another folder & continue writing to that folder & when that reaches its limit (card size permitting) it creates another folder until the card's limit is reached. I can't recall the number of files per folder but as a Mac user & Nikon shooter, I have never come across the problem.
Always great info....👍📷👌
@pal2tech, wonder if the problem goes away if you throw money at it? Like, for instance, do backup on a Gnarbox and then copy/transfer the images from the Gnar to the computer.
I don’t have a Gnarbox, but will consider getting one if it can read those SD cards.
always flip the little lock-tab to locked
position on a sd card, before reading it from a computer- you don’t want the computer to write to the card off-hand
first of all, thank you for talking about this. here is my case, I got XT4, and yes all of the pictures above 4096 could not be read on my Mac. but not it does not only do not show on the mac but also on the camera. did I just lose all of the pictures? please help,,
Hi Chris and Folks,
is this still an issue to take into account today on a M2 MacBook ?? Don't want to get surprised :)
but can you simple select files, drag to a different driver, delete from the sd card, eject and put it back in to see the rest ??
Great info as always!
Well I stopped using Mac OS a long time now. I think they're great machines but I find that I'm always getting connectivity issues with them. Also their laptops lack so many ports that I really cannot stick with their machines for this reason.
Great vid. Be interesting to try that out on Linux with some of the different computer drive formats: ext4 etc. Have a good weekend.
Coming to think of it I shot one of our local mountains one day recently I was shooting using 3 different sims, well well I put my sim card into a windows 10 computer. I transferred my files and I noticed that some was missing, I put that car back into the pc and the same thing files missing. I did not want to lose the files I had so in the end I just formatted the card and lost them, I know I had these files as I said I was trying the 3 different sims. I was so annoyed that I could not see them but could not do anything about it.
sounds like a faulty card. Can happen. Occasionally I've lost some photos to corruption, but not lately.
But in my asus laptop a17 camera sd card not showing video files only showing photos😢 please help
Are you sure this is UNIX related and not FAT12 related? Or the implementation of reading FAT filesystems by OSX? If you would try to put more than 4096 files in a normal folder on your hard drive, does that also give an error?
FAT32?
@@Mamotreco No, I thought maybe FAT12 cause of the 4096 limit, but FAT12 was limited to 4068 files it seems.
Thanks for this information
Chris… How many of your subscribers are stupid enough to put 4000 images on a single card? Every Competent photographer I know goes to great lengths to avoid data loss due to cards or hard drive failures. With this in mind why in the world would anyone put that many photos on a single card. I don’t deny the facts that you present, but come on now . You should re-edit the beginning of your video and make clear that this is malpractice to commit everything to one card period. Love your channel and thank you for all your hard work!
I experienced this issue as well. I could see the photos on the camera, but not on my mac. Plugged the SD card into my macbook, and when inserting it back into my X100V all photos above 4096 was gone. I can see the missing photos when running Disk Drill, but haven't successfully recovered them yet. Any recommendations on how to do so, without having to use Disk Drill, would be warmly received.
I am having the same problems, but more general reading issues on the San disk sd cards. I've already bought three and the issue continues. No problem on pc tho
always thanks from okinawa
I don't use a Mac but a great video for those that do!
I am facing this issue in windows laptop
What if this is happening to me but I only have 500 photos on my SD card and the last 200 are not showing up? My other SD card imported the 1800 with no issues.
What is you move some of the pics from the SD card to the local HD? this way yuo go belowe 4096 and the rest of the invisible files shoul be be back visible
So many photographers make up for lack of skill by machine gunning images. No sympathy! The only justifiable reason to have that many images on a single card is time lapse photography.
I agree sir. If I had 4000+ images ,I'd be spending weeks/months sorting them all out. I think they call it "spray & pray"
That what was my first thougt when I read the title. I miss old days when you would think before shoot..
Why would anyone have that amount of images on one card, apart from time lapse as you said. My largest card is 16gb and I have never filled it and I only shoot RAW.
I just switch back to Apple with the M1 mac SD cards and connecting cameras seemed to be the only problems I've run into.
Not having an SD card slot is the only issue with the M1 Mac Mini for me, a USB3 SD dongle works just fine. I also have a Thunderbolt dock from my previous Mac, which is a great help. No issues reading or writing to SD cards either. Testing shows the problem is the recent Fuji firmware update.
I don't shoot timelapse or spray and pray, so it won't actually affect me anyway. Once I've imported and backed up my images, I reformat the SD card in the camera, as I don't want duplicates floating around.
Legit argument, people pay Apple for a premium product with a premium price. This shouldn't be something you have to be aware of or manage or juggle with a premium priced product.
Something pretty stange :
I copied 4097 empty files to an SD card from a Windows machine, I can read them all from my Mac
I copied 4097 empty files to a TEST folder on the same SD, and I can also read them all from my Mac
I'm a little bit disapointed :-D
I have similar situation on PC now. I shot 912 photos yesterday (sony a7r3). I had 2 cards in camera. Sandisk and Sony. Then I came back home and checked card in my PC and it shows only 511 photos. So i inserted second card and go back to adobe bridge and all photos was in. But on second day i run PC again and this second card start showing only 511 photos as well on adobe bridge and explorer. So i check it on my laptop and the same... only 511 photos!
So I get back to my PC again and run lightroom and it show all 912 photos.
What is happening? I dont know...
is there any hope for photo files that have been recovered but are corrupted?
Another topic for you would be the limit that is posed on how long videos could be imported by image capture….tried to help my daughter with a schoolproject and the films were always to short. Drag and dropping the files from the sd card helped. Then there is the issue of not being able to read any of my lexar cards used in my gfx cameras on a mac….only solution is to use the camera as a cardreader.
I never knew this! Probably because I mostly use SDs no larger than 64gigs. Still, great to know.
Same here. I always clear my cards after importing and backing up, as SD cards are not longterm storage and I don't want duplicates floating around. Having old files on the card slows importing next time around. Besides, I have a 645Gb card in both slots set up sequentially, so it overflows onto a new card. For professional wedding and event photographers, they would probably like to have the space and use the 2nd slot for backup.
Neither have I ever shot that many photos in a day, even for a full festival going into the evening. I consider my shots and only do short bursts to capture action or expressions.
The issue is a Fuji firmware issue, hopefully they will fix soon for those affected. A workaround is to create a new folder in camera snd switch to it after shooting for a few hours, as the bug only affects individual folders.
@@msandersen usually I shoot redundant, just in case a card gets erased. I took a trip to Disneyland recently with my kids and had some once in a lifetime shots. Shortly after, my wife needed to film something for work, but wasn’t used to my X-T4. She tried erasing the footage and ended up erasing the entire card. Lucky for me, I had a second card and I have it set up where you have to go to each card to erase the photos you want. This saved me all my priceless photos of my kids. Since I didn’t have the chance to backup the photos right away, I would have been really upset if I lost everything. On a normal day, I usually backup my photos and put my SD card away and put in a new card. I personally haven’t lost and SD card pictures yet in the last 8 years, yet I’ve had a reliable flash storage not be so reliable and take a dump on me, which I know wasn’t overused and was taken care of properly. If my SDs weren’t working properly on top of this, I would have sent out everything to get restored and possibly saved if needed.
Hello there! I have transferred all the images from the SD on my Alpha 6000 to a Win PC's Folder
I have then upgraded my SD Card on my Alpha 6000 and restore all the images but the camera won't show them
It will show only the new pictures I have taken
How do I make my Sony Alpha show the photos again?
Thanks a lot in advance
found this by accident on my 2021 M1, 16gb RAM Mac Mini, using 128gb SD card same as yours 🤨
Thought it was a faulty SD reader
Mac also seems to have an issue with previewing compressed RAF files in Photos ... plenty of creatives use Mac, so 🤬?
Yes, neither MacOS nor iOS supports Compressed RAF (Fuji uses a proprietary compression). I keep hoping they will.
The specs of the machine, whether Intel or M1, or the size of the SD card above 32Gb matters in this issue. The issue is Fuji's exFAT firmware driver which seems to not handle anything above 12-bit directory entries properly (4096 files in any one directory). The files are still there, just not visible if you plug in the SD card into a Mac, iOS or Linux machine. I haven't heard about Android, but it is probably affected as well.
I've got an older Dell in the closet. I may unretire it for photos only & keep my Mac for the day to day things.
where did you get that jellyfish stuff aat the background. please link it. ty
my photo is missing from camera nikon D5600 ,
I move my pictures from my SD card to my PC and realized I want to keep sending them to my phone so I can move them back and now my camera and my phone don’t recognize any images is there a solution
How do you transfer without the camera on a windows PC?
Somewhat separate issue but I had just lost 250ish photos after opening files and putting them into different folders. Separated Jpg from Raw files, opened 6 in Lightroom, then they disappeared. Can't find them anywhere after originally being able to find them. Afraid to eject my sd card. Any thoughts?
In your video you show all the images you shot on your Fuji to one folder on the card
But - on all my cameras it states that no more than 999 files can be stored in a folder. If you try to - then a new folder is automatically created.
So - perhaps there is an issue - but camera makers know this limitation in the agreed camera/card/file standard and prevent the camera from creating the problem
If, however, the user manually copies all the images into a single folder - then there is a problem as you have by-passed the safety mechanism
So Chris, how did you end up with all the images in a single folder on the card as shown in the video?
Brian
A Fuji firmware to certain cameras increased the limit to 9999 files; in X-T3 it was firmware 3.20. I don't know when this particular bug was introduced, if it was then and nobody noticed until now, or there was a bug in the recent 4.10 or 4.11 update. Either way, someone pointed out an interesting fix: Since the problem is how the camera writes the directory entry, simply adding a single image file to the affected folder forces an update to the directory, and all your files reappear.
@@msandersen Martin - thanks for the info
I have checked the 'Design rule for Camera File system' which specifies the file system for camera cards and it states that there can be a maximum of 9999 files in a folder and a maximum of 999 folders. Perhaps different camera makers apply slightly different rules.
There is also the issue that different size cards/cameras may format cards using different settings. Anyway - an interesting issue.
Hi,I have a problem in my fijifilm camera, I accidentally deleted the wonderful photos, I tried to restore,but I couldn't..
Do you have any ideas to do that?
I watch most of the videos but none of them are successful 🙁
On my X-T200, and my daughter's X-A3, the camera has created a new folder under the DCIM folder for every 1000 shots, in your example, that would have folders 100_FUJI to 104_FUJI, if shooting JPEG only or raw only, then you have a base of 1000 files per folder, with JPEG+raw, 2000 files per folder, to exceed 4096 files per folder, you'd need to do a lot of in-camera edits. In both cameras, the default lifetime sequence numbering mode is active, I'm not sure if this behaviour changes if you change the sequence numbering settings. Does the X-T4 not use subfolders normally? Or does it just drop that when changing numbering settings?
Did you see the photoes on your camera?
Hi Chris, I came to your vid having the issue with the 4096 pictures. I do not own a Microsoft PC, what happens if I remove old pictures from my SD card. Will it show my newer pictures then? I'm quite hesitant to plug the SD card in my Mac and delete pictures and then find out I lost more than I intended to delete.
I am sure Apple will fix this in a future version of OSX or iOS or next Mac, MacBook. It's funny that Apple used to market their products as "it just works". I used both Windows and Mac. Nice to know I can work around it by using a Windows machine.
I took one video yesterday with my lumix and it didn’t pop up
Such an intriguing issue! I didn't want to sprain my trigger finger ;) so I tried an alternate way to reproduce the problem (and maybe find some workarounds). I formatted a 128G Sandisk SD card in my X-Pro3 and took one JPEG photo. Then, on my Macbook Pro 2018 (running Big Sur) I created 4100 copies of it onto the same directory. Guess what, no problems. I took some more shots onto the same card and put it back into my Mac. 4108 photos, all visible in Finder in one single folder, no problems.
Copying all those files was a bit slow, so to test with more files, I created some 8000 empty files onto another SD card (64G Kingston). Finder saw all 8000+ files there.
Do the files actually need to be created in camera to cause trouble? And why would that matter, if this is a Mac problem?
Yes, I've done testing on 2 Macs (2013 Intel Mac and new M1 Mac) and an iPad. I set the camera to shutter speed 1/8000, ISO 160, electronic shutter, 20 frames/sec, 'normal' jpg only, kept the lens cap on, and taped the shutter down until it had shot some 5000 images or so. I create a new folder in the camera and switched to it, and repeated. They show in the camera.
Long story short, connecting the SD card to either device only shows 4096 files in each folder; if you shoot RAW+jpg, that's 2048 images in each format. MacOS (same for Linux btw) can read and write any number of files to the SD card without issue, including the affected folders that only show 4096 shots. Adding files to the folder shows all the new files, including the original 4096, but never the 'hidden' ones. Removing files doesn't change anything.
Basically the issue was introduced in a recent Fuji firmware update where it now allows up to 9999 files in a folder, up from 999, and hence exposing the bug in their firmware which could have been there all along.
Edit: Someone found a simple workaround! Plug in your SD card and navigate to the affected image folder. Since the issue is how the Fuji firmware writes to the card directory, adding a single file to the folder forces an update to the directory, and ALL the files reappear!
Couldn't you just set up a folder on the SD card and cap it at 4000?
Photos also missing when zi insert sd card back to Canon camera
In other Unix systems it issue doesn't occured.
Soo its only apple things. 🧐
This is most likely due to the file system used by Apple and the address mapping in that file system.
SD cards are formatted exFAT, not an Apple format. For a long time,SD cards had a 4Gb limit (4096 bytes) due to the SDHC spec limitations.
@@msandersen 4 Gb is actually 4096 Mega bytes... 4294967296 bytec.
And 4096 and 4 files - photos to be precise - are unlikely to take up only 4096 Mb of memory, so this analogy makes rather little sense.
I have used and supported (worked on or around) windows for so long I can't imagine using a different OS. Not a mac hater just can't understand some of the weird limitations they have.
ExFat (Microsoft creation) was in time upgraded and changed, but not all avaible, like ntfs file system. This kind of problems born also with many cinema camera, for this reason many cinema camera allow you to format in hfs+. Exafat had lots of weakness
Could you not drag the first 100 or so images to a Mac folder and then delete these from the card?
Then the missing ones will appear?
No, that doesn't 'unhide' the hidden files. Connecting the camera via USB and importing with Image Capture works fine. The issue is the recent Fuji firmware.
Have a look at that!
Thanks Chris, and I agree on Apple. Ironically I have my 12 year old Lenovo Thinkpad Carbon for the same reason. Apple does not like to play nice. Whenever I lose something on my iMac, (my Canon scanner, my Garmin watch and nav as a few examples) my older PC is ready to go. And let's not forget Apple Aperture.
That goes for any computer; technology marches on, hardware, plugs, interfaces and protocols change all the time, see for instance USB over the past few years, and the mess that came before. New PCs with current Windows likely won't be able to connect those devices either. DLL Hell. All Windows users have had to deal with it. Good luck finding a drive that will work on a modern operating system. And Microsoft has abandoned plenty of software itself. People who rely on Microsoft Office have to keep an old computer with an old copy of Office around if they want to read old archived documents, as they drop support for older files occasionally. It's a big issue for governments around the world who are required by law to keep documents for 70 years or similar, depending on country.
What about an external usb card reader if you plug that into a MAC?
Same. Intel Mac or M1 Mac, old or new OS. Even iOS. It only happens if you've updated your Fuji firmware. MacOS has no issue with it's exFAT drivers, it reads and writes fine to the card. Basically in the new firmware, it allows 9999 photos in a folder, but something about how their exFAT driver writes the directory means only the first 4096 files in any given folder will show when plugging in the SD card, whether using a Mac or Linux. You can use the Finder to add or remove as many files as you like to the affected folders, the hidden files remain hidden, while any newly added files show up and open. Plugging the camera in via USB works, all images show and imports.
Taking over 4096 pictures in one take/folder/shoot..?
Then it’s a work flow problem if you ask me😁
And switching from Mac too Windows! just for this!??
I Love your videos and knowledge, but no I’m a bit disappointed!
Thanks for the info, I would NEWER! experienced it my self, with my work flow..😁👍
Just to be fair: The original post he refers to was a wedding photographer doing a whole-day shoot, shooting around 3000 photos ion both JPG and RAW, hence 6000 photos. Still a LOT of photos, and even in a full day to late evening Festival shoot have I ever gone near that. It's not an issue that affects me personally, and it can be worked around until Fuji fixes their firmware. Maybe the wedding had a lot of guests, and each had to have a photo...