What goes wrong with large sheets
Tens of thousands of rows may open fine in desktop Excel, but online tools can:
- Time out or fail mid-upload
- Freeze the browser tab during preview
- Produce huge SQL scripts that lock tables when run at once
Many ComTools Excel features cap around 50,000 rows per run (e.g. Excel to SQL, dedup). Use a slim → convert → load approach.
Limits at a glance
| Feature | Typical limit | Notes |
|---|---|---|
| Excel to SQL / Dedup | ~50k rows/run | Split files when larger |
| Batch INSERT | ~500 rows per statement | Still commit in chunks in the DB |
| Format preview | First ~10 rows | Export includes all rows |
| Dedup preview | Truncated display | Download is full result |
Tip 1: Split before you process
- By sheet: Excel Split into separate xlsx files.
- By row range: Filter by month/region and Save As multiple files or CSVs.
- By columns: Drop notes/temp columns before import to speed parsing.
Tip 2: Preview only what you need
- Prefer download result / .sql over long in-page scrolling.
- Excel Format preview is for style checks—then export.
- Excel Compare lists ~200 diffs; for full diff, to JSON locally.
Tip 3: Batch SQL loads
- Enable batch INSERT in Excel to SQL.
- Run the
.sqlin chunks of 500–1000 statements (or split files). - Optionally disable nonclustered indexes, reload, then rebuild.
- Verify
@@ROWCOUNT/COUNT(*)per batch.
Guides: INSERT, CSV import tips.
Tip 4: Merge and dedup order
Avoid merging into one giant file first:
Dedup small files (optional)
→ merge (or multi INSERT in DB)
→ final dedup if needed
→ Excel to SQL
Full chain: Merge → Dedup → SQL.
Tip 5: Encoding and headers
- Keep CSV as UTF-8.
- Normalize date displays before export.
- Clean headers (no spaces/duplicates)—see header normalization.
Checklist
[ ] Each file ≤ ~50k data rows (or already split)
[ ] Unused columns/sheets removed
[ ] Large jobs download results instead of long previews
[ ] SQL scripts batched; test DB OK
[ ] Production backup taken
Related tools
FAQ
Just over 50k rows?
Split by date or key range into two scripts and run in order.
Browser freezes?
Close heavy tabs; download instead of preview; split the file.
Raise the limit?
Shared online hosts keep a stability cap; for bigger loads use local scripts or BULK INSERT / LOAD DATA.