Recent searches
Search options
Hey #rstats #datadon #datascience folks:
What's a nice GUI program I can recommend to non-coders for browsing and searching a local folder of large CSVs dumped from a data (>100K rows each, multiple, different tables) exported from a database? Read-only is fine, fast full-text search and filter would be best.
I wonder if there's something #duckdb backed. @collinschwantes
I might add: support for exporting subsets (as CSV or even Excel would be nice)
Thanks for the many excellent and helpful replies here!
@noamross @collinschwantes Depending on how many columns the files have libreoffice calc could be able to handle this
@noamross @collinschwantes I would opt for OpenRefine. It is no-code but you can save and apply macros as json files.https://openrefine.org/
@jospueyo @noamross @collinschwantes I come here to mention OpenRefine too.
@noamross @collinschwantes does Rill do that?
@jaredlander @collinschwantes Seems interesting, but I would definitely would prefer a native app than something CLI-launched in the browser, and definitely need to avoid users needing knowledge of SQL.
@noamross @collinschwantes Oh, I thought it was a full GUI, nevermind
@noamross @collinschwantes
More TUI than strictly GUI, but I was impressed recently with https://www.visidata.org/
@noamross
I was a bit slow to realize, but I think tad by @antony might just check all boxes.
https://www.tadviewer.com/
https://github.com/antonycourtney/tad/
#csv, #parquet, #sqlite, #duckdb, #GUI
@noamross @collinschwantes i would suggest throwing them into an SQLite db using the CLI. You have access to indexing for full text search from there.
@noamross @collinschwantes ah just saw that you want a gui. You can import csv files to an SQLite db using
https://sqlitebrowser.org/blog/macos-installer-rebuilt-for-3-11-1/
@hye I was mostly looking for view/search rather than editors, but there are a couple of those in there, too.
@tpoisot Not in this case. This is for people working from offline dumps of our DB. But I'll take a look. Do you use it?
We use AirTable as the DB for a lot of our projects and I find it and some of the other no-code tools have some great advantages. I worry about escalating cost + sustainability, so we also try to make sure everything gets mirrored to something flat/static/FOSS. We dump our AirTables to big CSV dirs. But I need to point noncoders to ways to easily browse that data, too.
@noamross @collinschwantes Not sure if you found something but maybe Tad would be an option https://www.tadviewer.com/