Very Large File Downloads :: Support Forum

MGood1
Joined:: 2024-07-09
Posts:: 1

Very Large File Downloads

2024-07-09 20:21

We use WinSCP (version 5.19.2) via command lines in PowerShell scripts to download very large (multiple GB) files via FTP. It appears to hold the whole file in system memory as it is downloading and so we hit intermittent system memory errors when multiple processes are running. Is it possible to set up WinSCP so that it streams large files directly to disk rather than holding it in system RAM?

Reply with quote

Guest

2024-07-10 13:37

I don't see that happening with WinSCP by default. RAM usage isn't going up and the OS shows storage usage during transfer.

Maybe its related to how the OS is setup or something? I can only think of some most likely not used here situations like a RAM disk.

I would expect here instead that those memory errors be just a coincidence and you have something else going on.

At least that's what I get from your post. Maybe Martin will see something different?

Reply with quote

martin◆ Site Admin
Joined:: 2002-12-10
Posts:: 41,441
Location:: Prague, Czechia

Re: Very Large File Downloads

2024-07-12

Please attach a full session log file showing the problem (using the latest version of WinSCP).

To generate the session log file, enable logging, log in to your server and do the operation and only the operation that causes the error. Submit the log with your post as an attachment. Note that passwords and passphrases not stored in the log. You may want to remove other data you consider sensitive though, such as host names, IP addresses, account names or file names (unless they are relevant to the problem). If you do not want to post the log publicly, you can mark the attachment as private.

Reply with quote

Very Large File Downloads

Very Large File Downloads

Re: Very Large File Downloads

Documentation

Support

Associations

Follow Us