Summary
When parsing wide CSV files (e.g., 1000+ columns), Univocity throws an ArrayIndexOutOfBoundsException due to a hard limit of 512 columns. This prevents the ingestion of valid datasets with more columns.
How to Reproduce
- Create a CSV file with >512 columns (e.g., 1000 columns × 100 rows).
- Run the workflow using the CSV Scan Operator.
- Observe the error in the result panel (shown below)
