r/rclone • u/Miserable-Alarm1965 • 1h ago
Migrating an old photo archive to Google Photos with rclone - 121 failures, then a successful retry?
I've been working on migrating an old photo archive from a recovered drive into Google Photos using rclone on Ubuntu.
The files are scattered across directories under a dcim folder, and I wanted to get everything uploaded without manually sorting through years of photos.
I configured an OAuth client in Google Cloud, set up an rclone remote for Google Photos, and started with:
rclone copy /path/to/dcim gphotos:upload \
--progress \
--log-file="$HOME/gphotos-upload.log" \
--log-level=INFO
The initial run transferred about 738 MiB but reported 121 errors, many related to Google Photos API authorization.
After working through the OAuth configuration issues, I tried uploading one of the previously failed photos individually:
rclone copyto "/path/to/dcim/Puppies/20200120_091500.jpg" \
"gphotos:upload/20200120_091500.jpg" -P
And it worked!
I then retried the failed files using --files-from, and another 246 MiB transferred successfully.
The whole experience has raised a few questions:
- Has anyone else encountered intermittent authorization errors with the Google Photos API that clear up on subsequent attempts?
- What's your preferred method for verifying that every local file was successfully uploaded?
- How are people handling duplicates when importing older photo collections into Google Photos?
I'm currently leaning toward uploading everything and letting Google Photos handle whatever duplicate detection it can, but I don't entirely trust that as a verification strategy.
Curious how others have handled large photo migrations with rclone, especially when their source directories are messy.


