merari42@lemmy.world to Programmer Humor@programming.dev · 1 day agoWhat Drove You to Madness?lemmy.worldimagemessage-square31fedilinkarrow-up1512arrow-down151
arrow-up1461arrow-down1imageWhat Drove You to Madness?lemmy.worldmerari42@lemmy.world to Programmer Humor@programming.dev · 1 day agomessage-square31fedilink
minus-squarewise_pancake@lemmy.calinkfedilinkarrow-up6·edit-21 day agoMost recently: I had to parse an html table with a column of printed python dictionaries, the dicts wrapped a mixed delimiter list of SQL statements of various types. It’s truly an abomination. I’ve never had to use pythons AST module to parse data before…
minus-squarewise_pancake@lemmy.calinkfedilinkarrow-up2·edit-223 hours agoIt was 900mb raw and compressed to 1.6mb after cleaning. That’s how much junk data there was. Combing through that log is the only way to prove and identify where a big was introduced so I can fix it.
Most recently:
I had to parse an html table with a column of printed python dictionaries, the dicts wrapped a mixed delimiter list of SQL statements of various types.
It’s truly an abomination.
I’ve never had to use pythons AST module to parse data before…
🤮
It was 900mb raw and compressed to 1.6mb after cleaning.
That’s how much junk data there was.
Combing through that log is the only way to prove and identify where a big was introduced so I can fix it.