All 15 File System & File Processing questions
More in File System & File Processing
What is the difference between an absolute path and a relative path in Node.js, and how does __dirname help resolve paths reliably? What is the difference between fs.unlink() and fs.rmdir() (or the newer fs.rm()) in Node.js? How would you recursively read all files within a directory tree in Node.js? How would you safely check if a file exists in Node.js before attempting to read it, avoiding a race condition? What is the difference between fs.appendFile() and opening a file with the 'a' flag and writing to it manually? What is the difference between fs.stat() and fs.lstat(), and when does the distinction matter? How would you copy a large file efficiently in Node.js, and what's the difference between fs.copyFile() and manually piping streams? What is the purpose of the 'flag' option in fs.writeFile(), and what's the difference between 'w', 'a', and 'wx' flags? How would you implement a file-watching feature in Node.js using fs.watch(), and what are its known cross-platform limitations? How would you implement atomic file writes in Node.js to avoid leaving a file in a corrupted, half-written state if the process crashes mid-write?
Advertisement
Node.js › File System & File Processing

What is the difference between fs.readFile() and fs.createReadStream() for reading a file in Node.js?

Beginner

Answer

fs.readFile() reads an entire file into memory at once before invoking its callback with the complete contents -- simple, but problematic for large files since the whole file must fit in memory simultaneously. fs.createReadStream() reads the file incrementally in configurable chunks, emitting 'data' events as each chunk becomes available, using a bounded, predictable amount of memory regardless of the file's total size, making it the appropriate choice for processing large files.
// Loads the entire file into memory
fs.readFile('huge-file.csv', 'utf-8', (err, data) => { /* entire file in `data` */ });

// Processes incrementally, bounded memory usage
fs.createReadStream('huge-file.csv').on('data', (chunk) => { /* process one chunk at a time */ });
Real-world example A log-analysis tool processing multi-gigabyte log files switches from fs.readFile() (which was crashing with an out-of-memory error) to fs.createReadStream(), processing the file line by line with bounded memory regardless of the file's total size.

Common follow-ups: At what file size does the tradeoff meaningfully shift from readFile() being fine to streaming being necessary?;How would you process a stream line-by-line rather than in raw chunks?

Streams & Buffers;Performance Optimization & Profiling
All 15 File System & File Processing questions