Chunking

Data Chunking

Dividing data into smaller, manageable pieces for parallel processing, transfer, or memory-constrained environments.

Détail technique

Chunking is a common concept in file processing and digital tool workflows. Browser-based implementations use Web APIs (File API, Canvas, Web Workers) to process data entirely on the client device. This architecture eliminates server-side dependencies, reduces latency to near-zero for processing tasks, and ensures complete data privacy since files never leave the browser's sandbox. The primary constraint is browser memory — large files may require streaming or chunked processing approaches.

Exemple

```javascript
// Chunking: file processing example
const file = document.getElementById('fileInput').files[0];
const reader = new FileReader();
reader.onload = (e) => {
  const data = e.target.result;
  console.log(`Loaded: ${file.name} (${file.size} bytes)`);
};
reader.readAsArrayBuffer(file);
```

Termes associés

File Extension File Header Batch Processing Drag and Drop File Size Compression Ratio Conversion Preview UTF-8 API CLI Encoding Rendering Parsing Diff Endianness Serialization Linting Transpilation Stdin/Stdout Idempotency Deduplication Streaming Buffer Cache Sanitization Checksum Verification Concurrent Processing Pipeline Clipboard Archive File Permissions Symlink Buffering Glob Hot Reload Cron Stdin/Stdout/Stderr Dotfile