1 year ago
Fri Aug 11, 2023 2:07pm PST
Ask HN: Distributed Data Management Solutions?
I run a small earth sciences research group. I have a need for a good distributed management solution so group members can access data, contribute changes, etc. The aim is to be able to track changes to both data processing scripts, civ-type data text files, and processed binary files (think MatLab .mat files or NetCDF).

I've been experimenting with DataLad (https://www.datalad.org) which is a front-end for git+git-annex. It's ok although painfully slow as we have many small files to put into git-annex. It also requires quite granular understanding of how git-annex and git work, and it doesn't have any nice front-ends.

Are there any other open source solutions for this out there?

comments:
add comment
loading comments...