How I moved 1.5 million images into a QNAP NAS

Aug 31, 2023

Jeff Cable

Udi Tirosh is an entrepreneur, photography inventor, journalist, educator, and writer based in Israel. With over 25 years of experience in the photo-video industry, Udi has built and sold several photography-related brands. Udi has a double degree in mass media communications and computer science.

How I moved 1.5 million images into a QNAP NAS

Aug 31, 2023

Jeff Cable

Udi Tirosh is an entrepreneur, photography inventor, journalist, educator, and writer based in Israel. With over 25 years of experience in the photo-video industry, Udi has built and sold several photography-related brands. Udi has a double degree in mass media communications and computer science.

Join the Discussion

Share on:

Way back in February, I wrote a blog post telling you all that I was making a massive transition from the Drobo NAS system (now out of business) to the newer and far superior QNAP system. I had just installed the two new NAS systems back then but had not moved any data.

Many people (most of whom were using Drobo) wrote to me and asked how the QNAP transition was going. I told them it was too early to tell and that I had a lot of work to do before I could give them a fair and honest answer.

Here I am about six months later, and I have been using the system non-stop. I apologize for taking so long to write this follow-up review. There was a lot to do between then and now. Some had to do with the data transition, and some were just the back-to-back photo tours. No more excuses! Let me tell you what I have found, both the good and the bad.

Initial QNAP Setup

Let me start with the installation of the boxes. I had two NAS systems to set up, one of which would be my primary storage and one which would be my offsite destination. I had a whole bunch of the Seagate IronWolf 20TB hard drives to install, and I also purchased a couple of M2 SSD drives to increase the overall speed of the drive access. Installing the drives was simple enough, and powering up the QNAP boxes was a piece of cake. I did have to make some phone calls to the support team when I got stuck, and they were very helpful in getting me up and running.

QNAP TVS-h874 NAS - the box

My goal was to transition all 1.5 million photos (and other data) from the Drobo NAS to the new QNAP TVS-h874 NAS (about $2500). This process took a REALLY long time. I would transfer one year of data at a time, and I think it took me the better part of two weeks to complete the process.

QNAP and MAC indexing issue

Once I got everything moved over, everything appeared to be perfect, with one hiccup. When I attempted to search for a folder on the drive (using my Mac Studio), the folders could not be found. It turns out that the NAS was not indexed.

The “amazing” thing is… there is no easy way to re-index a drive from a Mac, so I had to research a way to make that happen. Once I figured out how to make that happen, it took another five days! And this problem has not been completely resolved. There are still times when the indexing goes haywire (when I search for a folder, it shows the folder, I click on it, and it opens a completely different folder), and I have to force a re-index. This process generally takes a couple of days (in the background), which is a real nuisance since it slows the drive to a crawl. I have searched the Internet for answers, and this seems to be an issue with the Mac and many NAS drives. I am hoping that someone at Apple can help me resolve this.

How I work on my files

Initially, I thought I would use the QNAP NAS as my main working drive, but I have decided to use the new 4TB Crucial x10 SSD drive as my main drive. I chose to make this change for two reasons:

  • The Crucial SSD is incredibly fast, much faster than accessing the QNAP drive over Ethernet.
  • If the indexing problem happens again, I can still work with the SSD without any delays while re-indexing the NAS.

Setting up the QNAP remote synchronization

 QNAP TVS-h874 NAS and QNAP TS-832PX: side by side

In the previous blog post, I showed the two QNAP units side by side. My next step was to copy all the data from the QNAP TVS-h874 NAS (primary drive) to the QNAP TS-832PX NAS drive (my offsite drive). The QNAP support people helped me connect the two boxes together and start the synchronization. I knew the synchronization had first to be done locally (on the same network) because trying to sync up 1.5 million images to a remote location over the Internet would take forever.

That process took another 3 or 4 days, but I did not have to do anything. We started the sync, and I let it run.

At that point, I needed to drive the second box to my remote location, a couple of hundred miles away at my brother’s home. Once I got the second box powered up at my brother’s, I once again leaned on the QNAP support people to help me with the remote sync settings. This process was so simple and painless. I was amazed! With the old Drobo unit (using their Drobo DR software), the user interface was terrible, the process was painstaking, and it always failed. I have been dying for a reliable system to keep my data safe in multiple locations. Now I have it.

QNAP user interface and features

QNAP TVS-h874 NAS - user interface

The user interface for the QNAP is all browser-based and is very straightforward. I have not used most of the icons you see above, mostly using the HBS 3 Hybrid Backup Sync app for the remote synchronization. I sometimes use the File Station application, but I mainly use the Mac Finder to find what I am looking for.

QNAP TVS-h874 NAS - file station

This is what the File Station interface looks like—a simple interface for viewing the files and folders stored on the NAS drive.

QNAP TVS-h874 NAS - app center

There are numerous applications that can be installed on the QNAP NAS drive. I have installed a couple of apps (for the backup and remote access). I have been tempted to install the media streaming app (just for fun) but have not yet done so.

QNAP TVS-h874 NAS - control panel

The Control Panel is where I set all my settings for the NAS unit, with me generally using the “General Settings” more than anything else.

QNAP TVS-h874 NAS - Storage screen

Within the General Settings, I can check the status of all the drives. This screenshot shows the status of the two internal SSDs and all the Seagate IronWolf 20TB hard drives.

As I mentioned, I am using the the HBS 3 Hybrid Backup Sync app (no additional charge for this) for my remote synchronization. This application runs on both boxes and synchronizes every morning at 1 a.m. It has been running for the last six months without any issues or failures. This means I have all 1.5 million images in both places for extra security, and it stays updated constantly. This is a huge peace of mind for me (and my clients).

QNAP TVS-h874 NAS - remote backup

When using the Drobo DR software, I would constantly bug the development team at Drobo to give me some interface to show the synchronization progress. With the Drobo, there was almost no way to see if the synchronization was successful or how much data was transferred. They never fixed that issue, creating times when the sync process was broken for months without my knowledge. With the QNAP Sync log, I have an easy way to check my sync’s status to ensure they are happening.

QNAP TVS-h874 NAS - snyc status

If I click on one of the items in the Sync log, I can see more details of that particular process. In the example above, I can see that on August 28, 54GB of data was sent from my TVS-h874 NAS drive to the TS-832PX NAS drive hundreds of miles away. It took about an hour to synchronize the 4914 files.

QNAP TVS-h874 NAS - synchronization

Since we are on remote data, I have to talk about one of my favorite things about the QNAP NAS drives and one of the biggest differences between the old Drobo system and these new units. I am talking about the ability to easily access ANY of my files from ANYWHERE in the world. Drobo did have the ability to access their NAS drive from a remote location using a web browser, but it was painfully slow.

There are many times when I am traveling and need to access images for a client. Searching for a file on the old Drobo NAS would take me 15 to 20 minutes to locate a file since the interface was brutally slow. With the QNAP drives, I can now find that same file in less than a minute, and I LOVE that! Not only can I check files on my local drive, but I can access the remote drive as well.

QNAP TVS-h874 NAS - remote drives via the app

Oh, one more thing. There is another feature of the QNAP NAS that is not critical but which I really love. That is the auto backup of my camera roll from my phone whenever I get in range of my WiFi network. This means that I do not have to do this manually or rely on iCloud or other services to back up my photos and videos from my iPhone.

Conclusion

When Drobo started showing signs of their pending demise, I was in a panic. I had ALL my data on their boxes, and both the company and the units were failing. I literally lost sleep worrying about this problem. I pride myself on having every digital image I have ever taken (the keepers) and having them in two locations. I even tell my clients about this setup so that they know I will have their images safe for years to come.

I can tell you now that the panic is gone, and I am really happy with the new QNAP solution. I have not only replicated what I was doing with the Drobo units but surpassed the functionality and usability by far! It is not an inexpensive solution, but it is something that is vital to my business. As professional photographers, our data is everything; keeping those images safe is critical. I am now sleeping better at night.

About the Author

Jeff Cable is a world-renowned, seven-time Olympic photographer, having covered Beijing, Vancouver, London, Sochi, Rio, Pyeongchang and Tokyo. He is one of the most sought-after presenters and educators in the photography space. You can find out more about Jeff on his website, follow his adventures on his blog, or reach out to him through Facebook. This article was also published here and shared with permission.

Filed Under:

Tagged With:

Find this interesting? Share it with your friends!

DIPY Icon

We love it when our readers get in touch with us to share their stories. This article was contributed to DIYP by a member of our community. If you would like to contribute an article, please contact us here.

Join the Discussion

DIYP Comment Policy
Be nice, be on-topic, no personal information or flames.

Leave a Reply

Your email address will not be published. Required fields are marked *

2 responses to “How I moved 1.5 million images into a QNAP NAS”

  1. Rob Sirota Avatar
    Rob Sirota

    Jeff why QNAP over Synology?

  2. alexk Avatar
    alexk

    You read about the Many security issues that QNAP failed to address time and time again, plus the new trend of ransomware.
    “DeadBolt has already infected thousands of QNAP storage devices this year.”

    How do you feel comfortable connecting it to the interned?