Open Library Data Dumps

Open Library provides dumps of all the data in various formats. Currently these dumps are generated every month.

OL Dump

This contains dump of latest editions of all the records in Open Library. This is a tab separated file with the following columns:

• type - type of record (/type/edition, /type/work etc.)
  
• key - unique key of the record. (/books/OL1M etc.)
  
• revision - revision number of the record
  
• last_modified - last modified timestamp
  
• JSON - the complete record in JSON format

This full dump (~7.8G compressed) can be downloaded from:

https://openlibrary.org/data/ol_dump_latest.txt.gz

For convenience, this dump is split into multiple files based on type.

• editions dump (~ 5.7G) - https://openlibrary.org/data/ol_dump_editions_latest.txt.gz
  
• works dump (~ 1.6G) - https://openlibrary.org/data/ol_dump_works_latest.txt.gz
  
• authors dump (~ 0.3G) - https://openlibrary.org/data/ol_dump_authors_latest.txt.gz

OL Complete Dump

This contains dump of all revisions of all the records in Open Library (~18.3G compressed). Format is same as the OL dump.

This dump can be downloaded from:

https://openlibrary.org/data/ol_cdump_latest.txt.gz

Format of JSON records

A JSON schema for the various types is located at https://github.com/internetarchive/openlibrary-client/tree/master/olclient/schemata

Author Record

JSON serialization of a type/author

Edition

JSON serialization of a type/edition

Work

JSON serialization of a type/work

OL Covers Dump

:TODO: