Asterrr's Handbook

Data transfer

Choosing between DataSync, Transfer Family, Snowball Edge, S3 Transfer Acceleration, Direct Connect, VPN and Storage Gateway by data size, bandwidth, deadline and pattern.

Exam tasks: 4.2 (select the appropriate data transfer service and migration strategy, apply the appropriate security methods to migration tools)

The decision: how much data, how much usable bandwidth, how long until the deadline, and is this a one-time move or a flow that keeps running afterwards?

Choosing a service

How long will the network take?

Transfer time in days is roughly bytes × 8 ÷ (bits per second × utilization) ÷ 86,400. The table assumes you can sustain 80% of the link for the transfer, which is optimistic if the link also carries production traffic.

Data100 Mbps1 Gbps10 Gbps
1 TBabout 28 hoursabout 3 hoursabout 17 minutes
10 TBabout 12 daysabout 28 hoursabout 3 hours
100 TBabout 116 daysabout 12 daysabout 28 hours
1 PBabout 3 yearsabout 116 daysabout 12 days
≈ 8.6 TB/day
What a 1 Gbps link moves at 80% utilization. Scale linearly with bandwidth.
1.25 Gbps
Per Site-to-Site VPN tunnel. More needs ECMP across tunnels on a Transit Gateway.
Weeks
Typical lead time for a new Direct Connect connection. Don't count on it for a short deadline.
10 Gbps
What a single DataSync task can drive, given enough network.

Do the arithmetic

Many transfer questions are solved by a quick calculation. If the network needs more than about a week and the deadline is close, or the link is shared with production, look for an offline option. If the network finishes comfortably, online is simpler and avoids shipping logistics.

Online options

ServiceBest forWhat to know
DataSyncBulk or recurring copies of NFS, SMB, HDFS or object stores into S3, EFS or any FSx file systemAgent VM on premises. Incremental, verifies integrity, preserves metadata, can throttle bandwidth, runs on a schedule. Also copies between AWS storage services and other clouds
Transfer FamilyPartners or legacy systems that push files over SFTP, FTPS, FTP or AS2Managed endpoint in front of S3 or EFS. Keeps partners' existing clients and scripts unchanged. Identity from service-managed users, Directory Service or a custom Lambda provider
S3 Transfer AccelerationUploads to one bucket from clients far from its RegionRoutes through CloudFront edge locations over the AWS backbone. Uses a separate accelerate endpoint. You pay only when it's faster
Direct ConnectLarge, steady transfers and a private, consistent pathDedicated connections from 1 Gbps up, or smaller hosted connections through a partner. Not encrypted by itself: add MACsec or a VPN over it
Site-to-Site VPNQuick encrypted connectivity over the internetUp in minutes, but internet throughput and latency vary

Transfer Acceleration for a data center move

Transfer Acceleration speeds up long-distance uploads to S3. It doesn't add bandwidth: if the data center's internet link is the bottleneck, it won't help. It also only targets S3, so it's wrong for moving an NFS share into EFS.

FTP and encryption

Transfer Family supports plain FTP only on endpoints inside a VPC, never on public ones, because FTP sends credentials in cleartext. If a question requires encryption in transit, pick SFTP or FTPS.

For network details see hybrid connectivity.

Offline: Snowball Edge

An AWS-owned, ruggedized device shipped to your site. You copy data locally, ship it back, and AWS imports it into S3.

  • Storage Optimized devices are for bulk migration. Compute Optimized devices add more vCPUs for edge processing at disconnected sites.
  • Data is encrypted with KMS keys you control, and the device is erased after import.
  • Order several devices in parallel for petabyte-scale moves. The end-to-end cycle, including shipping, takes days to weeks per device.
  • Pair it with an ongoing method, like DataSync or DMS CDC, to catch changes made after the copy.

2025 availability change

Snowball Edge stopped accepting new customers on November 7, 2025. AWS now points new customers to DataSync for online transfer and AWS Data Transfer Terminal, physical sites where you bring your own storage and upload at high speed. The exam still tests Snowball Edge as the offline answer.

Legacy: use Snowball Edge, or Data Transfer Terminal instead

Snowmobile, a shipping container for exabyte-scale moves, has been retired. Snowcone, the small 8 TB and 14 TB device, has been discontinued. Older material may still use them as answers.

Hybrid and ongoing: Storage Gateway

Storage Gateway runs as a VM or hardware appliance on premises. It gives local applications a familiar protocol and a local cache, and stores the data in AWS.

GatewayProtocol on premisesData lands inUse for
S3 File GatewayNFS or SMBS3 objects, one file per objectFile shares backed by S3, feeding data lakes, tiering old files to cheaper S3 classes
FSx File GatewaySMBFSx for Windows File ServerLow-latency local access to a cloud Windows file share
Volume Gateway, cachediSCSIS3, primary data in AWS with a local cacheExtending block storage into AWS
Volume Gateway, storediSCSILocal primary copy, async backup to AWS as EBS snapshotsKeeping all data local with cloud backup and DR
Tape GatewayiSCSI virtual tape libraryS3, archived to S3 Glacier Flexible Retrieval or Deep ArchiveReplacing physical tape with existing backup software

Legacy: use FSx for Windows File Server accessed directly, or S3 File Gateway instead

FSx File Gateway stopped accepting new customers in October 2024. It still appears in exam questions about caching an FSx for Windows share locally.

Migration or hybrid?

DataSync moves data and you're done. Storage Gateway is for when applications keep running on premises and keep using NFS, SMB, iSCSI or tape. If a question says the application stays on premises, it's usually a gateway.

Scenarios

Scenario
A media company must move 400 TB of video from an on-premises NAS to Amazon S3 within 3 weeks. Its only connection is a 1 Gbps internet link that is already 60% used during business hours. What should the architect recommend?
Scenario · choose 2
A bank exchanges daily settlement files with 40 partners, who push them over SFTP to a server in the bank's data center. The bank wants to move the files into S3 and retire the server without asking partners to change anything. Which TWO actions meet the requirements?
Scenario
A hospital keeps its imaging application on premises. It wants old image files to live in Amazon S3 for durability and analytics, while the application keeps writing to an SMB share with low latency for recent files. What should the architect use?

Further reading

On this page