All 15 File System & File Processing questions
More in File System & File Processing
How would you recursively read all files within a directory tree in Node.js? How would you safely check if a file exists in Node.js before attempting to read it, avoiding a race condition? What is the difference between fs.appendFile() and opening a file with the 'a' flag and writing to it manually? What is the difference between fs.stat() and fs.lstat(), and when does the distinction matter? What is the purpose of the 'flag' option in fs.writeFile(), and what's the difference between 'w', 'a', and 'wx' flags? How would you implement a file-watching feature in Node.js using fs.watch(), and what are its known cross-platform limitations? How would you implement atomic file writes in Node.js to avoid leaving a file in a corrupted, half-written state if the process crashes mid-write? How would you process a very large CSV file in Node.js without loading the entire file into memory? How would you implement file locking in Node.js to prevent two processes from writing to the same file simultaneously? How would you implement a directory-size calculator in Node.js that recursively sums the size of all files within a directory tree?
Advertisement
Back to results for “File System”
Node.js › File System & File Processing

How would you copy a large file efficiently in Node.js, and what's the difference between fs.copyFile() and manually piping streams?

Intermediate

Answer

fs.copyFile() (or fs.cp() for directories) performs an efficient, often OS-optimized file copy in a single call, suitable for most use cases. Manually piping a read stream to a write stream (fs.createReadStream(src).pipe(fs.createWriteStream(dest))) offers more control -- useful if you need to transform the data during the copy (like compressing it), but generally has more overhead than the OS-level optimized copy that fs.copyFile() can leverage for a plain, unmodified copy.
// Simple, efficient copy
await fs.promises.copyFile('source.txt', 'destination.txt');

// Manual piping, useful when transforming data during the copy
fs.createReadStream('source.txt').pipe(zlib.createGzip()).pipe(fs.createWriteStream('destination.txt.gz'));
Real-world example A backup utility uses fs.copyFile() for straightforward file duplication (letting the OS handle the copy as efficiently as possible), but switches to manual stream piping specifically when it needs to simultaneously compress files during the backup process.

Common follow-ups: Does fs.copyFile() actually use OS-level fast-copy mechanisms like copy_file_range on Linux, and how does that affect performance for very large files?;What happens if the destination file already exists when using fs.copyFile()?

Streams & Buffers;Performance Optimization & Profiling
All 15 File System & File Processing questions