Using an Open Source Python Toolbox (Signac) to Manage High Dimensional Research Data

Simple item page
dc.creatorXiyu Du, Chrisy
dc.date.accessioned2023-04-24T21:46:16Z
dc.date.available2023-04-24T21:46:16Z
dc.date.issued2023-04-14
dc.description2023 Symposium for Caring for Data in Hawaiʻi Presentation
dc.description.abstractMany research fields have entered the age of Big Data. For some researchers, big data means computationally generating large datasets with high dimensional parameter sweeps; for others, big data means generating terabytes of experimental data with many different types of metadata based on experimental conditions. Recording and storing these data in an organized way for future analysis can be challenging, as many ad hoc solutions might help the exact current situation but hurt one's progress later on. Having battled these challenges, I want to share my experience working with an open-source data management system based on Python called Signac. Signac was first developed in the Glotzer Group at the University of Michigan, where I was a graduate student, to help manage different kinds of molecular dynamics simulations, but later extended to support many different kinds of data. In this talk, I want to briefly talk about the design philosophies of Signac and give a quick demonstration of how one could use Signac to help with their research based on my personal experiences.
dc.formatVideo
dc.format.extent20 minutes
dc.identifier.urihttps://hdl.handle.net/10125/104897
dc.languageeng
dc.rightshttp://rightsstatements.org/vocab/InC/1.0/
dc.subjectdata management
dc.titleUsing an Open Source Python Toolbox (Signac) to Manage High Dimensional Research Data
dcterms.typeMovingImage
dcterms.typeStillImage
dspace.entity.type

Files

Original bundle
Now showing 1 - 2 of 2
No Thumbnail Available
Name:
Signac_Chrisy_compressed.mp4
Size:
48.15 MB
Format:
Download
Thumbnail Image
Name:
12_UH_Data_2023.pdf
Size:
2.09 MB
Format:
Adobe Portable Document Format
Download
License bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.73 KB
Format:
Item-specific license agreed upon to submission
Description:
Download

Collections

Caring for Data in Hawaiʻi Symposium 2023