SlideShare Explore Search You
Upload Login Signup
Search
Submit Search
Home Explore Presentation Courses PowerPoint Courses by LinkedIn Learning Search Successfully reported this slideshow. We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
1 of 25
Integrating DuraCloud with DPN at Chronopolis and the Texas Digital Library 737 views Share Like Download ...
Bill Branan, DuraCloud Technical Lead
DuraSpace Follow Published on Jun 12, 2015
How DuraCloud is used by Chronopolis and the Texas Digital Library to transfer ... Published in: Software License: CC Attribution-ShareAlike License 0 Comments 2 Likes Statistics Notes
Full Name Comment goes here. Hosted digital preservation service •Distributed off-site storage •Extremely large storage capacity •Automated duplication... 12 hours ago Delete Reply Block Are you sure you want to Yes No Your message goes here
Share your thoughts… Post Be the first to comment
Sibyl Schaefer 2 years ago
Rajesh Parashar , Sr.Research Analyst at IKC-Indian Knowledge Corporation at IKC-Indian Knowledge Corporation 2 years ago No Downloads Views Total views 737
On SlideShare 0 From Embeds 0 Number of Embeds 79 Actions Shares 0 Downloads 9 Reasons to Partner Shared beliefs • Digital content preservation is important to the future of society • Digital preservat... Comments 0 Likes 2 Embeds 0 No embeds No notes for slide
Integrating DuraCloud with DPN at Chronopolis and the Texas Digital Library 1. 1. INTEGRATING DURACLOUD WITH DPN AT CHRONOPOLIS & THE TEXAS DIGITAL LIBRARY Bill Branan Sibyl Schaefer Ryan Steans Open Repositories 2015 2. 2. Bill Branan, DuraCloud Technical Lead 3. 3. Hosted digital preservation service •Distributed off-site storage •Extremely large storage capacity •Automated duplication •Automated synchronization tooling •Verified data integrity •Simple UI administration •Powerful integration options •Comprehensive REST API •Predictable annual billing •Personalized support •Open to anyone •Open source code DuraCloud 4. 4. Reasons to Partner Shared beliefs • Digital content preservation is important to the future of society • Digital preservation needs to be easier to accomplish • A digital preservation solution must be economically viable • Need to support preservation needs of all institutions, regardless of size or technical capability Compatible organizational strengths 5. 5. Shared Solution Purpose of DPN • Formed to ensure long term preservation of the digital scholarly record • Protects against catastrophic loss due to technology, organization, or natural disasters • Provides a financial model for the preservation of content over time • For the academy, by the academy 6. 6. Structure of DPN • 5 founding nodes in preservation federation • More nodes to be added over time • Nodes differ from one another in: • Underlying storage technology • System administration techniques • Geographical location • Nodes may choose to receive data from external institutions, from other DPN nodes, or both • Each node may offer additional features and functionality 7. 7. DuraCloud Vault • Front end: DuraCloud • Back end: Chronopolis Texas Preservation Node - TPN • Front end: DuraCloud @ TDL • Back end: TACC (Texas Advanced Computing Center) Two DPN nodes Shared Solution Purpose of DPN • Formed to ensure long term preservation of the digital scholarly record • Protects agains... 8. 8. Integration Strategy 9. 9. DPN Network DPN Node 2 DPN Node 3 Chronopolis / TPN DPN Node S3 Glacier DuraCloud UI Storage Mediation Manifest Store Original Content Store REST API Sync Tool Data Owner Snapshot Bridge Bridge Storage Bridge Application 10. 10. Sibyl Schaefer, Digital Preservation Analyst, UCSD 11. 11. Chronopolis Digital preservation storage network spanning multiple institutions and geographic regions Focused on: active preservation – constant checking of items First ingest date: 2008 Trusted Digital Repository Certification: 2012 12. 12. Partnering with DuraCloud o DuraCloud as a pathway to Chronopolis Provides an existing hosted user interface, reduced need for new development Simplifies the process of moving content in and out of the systems Shared institutional values o Chronopolis as a storage provider for DuraCloud Extends the DuraCloud network to include a noncommercial, highly distributed, dark archive option 13. 13. DuraCloud Vault Providing an end-to-end DPN node solution. Agnostic to content format, type, and size All data is welcome Full access to content through DuraCloud Only DPN node offering ingest to any DPN member at DPN soft launch (July 1, 2015) http://duracloud.org/duracloud-vault 14. 14. S3 Glacier DuraCloud UI Storage Mediation Manifest Store Original Content Store REST API Sync Tool Data Owner Snapshot Bridge Bridge Storage Bridge Application Maryland UCSD NCAR DPN Node 2 DPN Node 3 DPN Network Chronopolis 15. 15. Chronopolis backend l Content pulled from staging, then verified l Copies created in one of the distributed data centers (option to distribute to all three) l Coordination with DPN to push content to nodes within DPN 16. 16. Chronopolis JBOD Replication service ACE NCAR JBOD Replication service ACE UMIACS Ingest Ingest service Postgres Isilon Replication service ACE UCSD Bridge 17. 17. TEXAS DIGITAL LIBRARY Ryan Steans, Director of Operations 18. 18. A Cooperative Project Texas Preservation Node Partners Texas Advanced Computing Center – High Performance super computer center with 6 PB available within just “Corral” UT Libraries – Providing oversight of the project and supporting DPN development TDL – Developing ingestion point for users of TPN via DuraCloud™ 19. 19. TDL Membership TPN First Users 20. 20. Why DuraCloud? • Open Source • Flexible enough to handle multiple user requirements and extendible • DuraCloud fit with TDL’s use of existing DuraSpace technology (DSpace) • Before DPN - DuraCloud experiments already underway between TDL and TACC • Able to build upon work done with Chronopolis with different TPN architecture • Extend local preservation plan to include DPN Structure of DPN • 5 founding nodes in preservation federation • More nodes to be added over time • Nodes differ from one ... 21. 21. DuraCloud™@TDL as a Service • Available as of January 2015 (it’s here!) • Consistent Upgrades - at DuraCloud 3.2 • Charge-back model – Members pay for what they use • Cost varies depending upon storage option • TDL Membership covers cost of running the basic service, technical support, etc… 22. 22. TDL Preservation Architecture E C 2 S3 Glaci er l EC2 Computing l S3 Content Delivery Network l Glacier “Dark” Storage l CloudFront Streaming l iRODS @ TACC “Dark” Storage l TPN/DPN CloudF ront 23. 23. Original Content Store Snapshot DuraCloud™@TDL UI REST API Storage Mediation Bridge Staging Storage Bridge Application TDL AWS DPN Node 2 DPN Node 3 Manifest Store DPN Network Sync Tool Data Owner DuraCloud Interface Archivematica? GlacierS3 TACC TPN UTLib AWS TPN/DPN Bagger – bridge client TPN iRODS @ TACC 24. 24. Contributions DuraCloud l https://github.com/duracloud/duracloud l https://github.com/duracloud/snapshot l https://github.com/duracloud/mill University of Maryland Institute for Advanced Computer Studies l https://github.com/msmorul/irods-api l https://gitlab.umiacs.umd.edu/adapt/ace Texas Digital Library l https://github.com/TexasDigitalLibrary/duracloud l https://github.com/TexasDigitalLibrary/irods-api 25. 25. Questions? Bill Branan
[email protected] Sibyl Schaefer
[email protected] Ryan Steans
[email protected] Recommended College Prep: Writing a Strong Essay Online Course - LinkedIn Learning
DuraCloud Vault • Front end: DuraCloud • Back end: Chronopolis Texas Preservation Node - TPN • Front end: DuraCloud @ TDL ...
Integration Strategy
100 Courses and Counting: David Rivers on Elearning Online Course - LinkedIn Learning
DPN Network DPN Node 2 DPN Node 3 Chronopolis / TPN DPN Node S3 Glacier DuraCloud UI Storage Mediation Manifest Store Orig...
Learning How to Increase Learner Engagement Online Course - LinkedIn Learning
Deimos building control suite esp Vicente Muelas Sanz de Andino
Tips to Progress Car Transport Prices carshippingrates
Codigo etica presentación- reunión 21-11-2006 Carlos Alberto Trapani
Sibyl Schaefer, Digital Preservation Analyst, UCSD
HOJA DE VIDA Anda Pero Si Es John
LIBRO "CREANDO EMPRESA" patagutel
Perú Selene Guzmán
Chronopolis Digital preservation storage network spanning multiple institutions and geographic regions Focused on: active ... Sup.univ austral marzo2008 Susy Inés Bello Knoll English Español Português Français Deutsch About Dev & API Blog Terms Privacy Copyright Support
LinkedIn Corporation © 2018 Partnering with DuraCloud o DuraCloud as a pathway to Chronopolis Provides an existing hosted user interface, reduced ne... × Share Clipboard × Email
Enter email addresses Add a message From
Send Email sent successfully.. Facebook Twitter LinkedIn Link DuraCloud Vault Providing an end-to-end DPN node solution. Agnostic to content format, type, and size All data is welc... Public clipboards featuring this slide
×
S3 Glacier DuraCloud UI Storage Mediation Manifest Store Original Content Store REST API Sync Tool Data Owner Snapshot Bri...
No public clipboards found for this slide × Chronopolis backend l Content pulled from staging, then verified l Copies created in one of the distributed data centers (...
Save the most important slides with Clipping Clipping is a handy way to collect and organize the most important slides from a presentation. You can keep your great finds in clipboards organized around topics. Start clipping No thanks. Continue to download. Select another clipboard ×
Chronopolis JBOD Replication service ACE NCAR JBOD Replication service ACE UMIACS Ingest Ingest service Postgres Isilon Re...
TEXAS DIGITAL LIBRARY Ryan Steans, Director of Operations
Looks like you’ve clipped this slide to already. Search for a clipboard Create a clipboard
You just clipped your first slide! Clipping is a handy way to collect important slides you want to go back to later. Now customize the name of a clipboard to store your clips. Name* Best of Slides
Description Add a brief description so others know what your Clipboard is about. Visibility Others can see my Clipboard Cancel Save Save this presentationTap To Close A Cooperative Project Texas Preservation Node Partners Texas Advanced Computing Center – High Performance super computer c...
TDL Membership TPN First Users
Why DuraCloud? • Open Source • Flexible enough to handle multiple user requirements and extendible • DuraCloud fit with TD...
DuraCloud™@TDL as a Service • Available as of January 2015 (it’s here!) • Consistent Upgrades - at DuraCloud 3.2 • Charge-...
TDL Preservation Architecture E C 2 S3 Glaci er l EC2 Computing l S3 Content Delivery Network l Glacier “Dark” Storage...
Original Content Store Snapshot DuraCloud™@TDL UI REST API Storage Mediation Bridge Staging Storage Bridge Application TDL...
Contributions DuraCloud l https://github.com/duracloud/duracloud l https://github.com/duracloud/snapshot l https://github....
Questions? Bill Branan
[email protected] Sibyl Schaefer
[email protected] Ryan Steans
[email protected]
Upcoming SlideShare
Loading in …5
×