Skeletor is here to help

https://lemmy.world/post/38263914

Skeletor is here to help - Lemmy.World

Lemmy

Sadly, no. CSV files can deal with embedded commas via quoting or escaping. Given that most of the dumps are going to be put together and consumed via common libraries (e.g.pythonโ€™s csv module), thatโ€™s all going to happen automagically.

Can be != will be

Youโ€™re looping over 50M records, extracting into your csv. Did you bother using the appropriate library, or did your little perl script just do split(/,/,$line)