42 lines
1.9 KiB
Markdown
42 lines
1.9 KiB
Markdown
# Create a Bookwyrm-ready import list from humble bundle
|
|
|
|
Usage: `./grab.nu <link-to-humble-book-bundle-page>`
|
|
|
|
For example: `./grab.nu https://www.humblebundle.com/books/data-engineering-science-oreilly-books | save -f data-eng.csv`
|
|
|
|
Will download book info in parallel, but often does not find enough info for _all_ books.
|
|
|
|
## Internal logic
|
|
|
|
- get humble bundle page
|
|
`http get https://www.humblebundle.com/books/software-architecture-pearson-books`
|
|
- extract correct element for json data
|
|
`open out.html | pup "script#webpack-bundle-page-data text{}" | from json`
|
|
|
|
- get transposed version
|
|
`open books.json | get bundleData.tier_item_data | transpose machine_id item | insert human_name {$in.item.human_name} | insert cover_art {$in.item.resolved_paths.front_page_art_imgix_retina} | insert publisher {$in.item.publishers.0.publisher-name} | reject item`
|
|
- get details of books into tabled format
|
|
`open books_transposed.json | where machine_id != "code_org" | insert human_name {$in.item.human_name} | insert cover_art {$in.item.resolved_paths.front_page_art_imgix_retina} | insert publisher {$in.item.publishers.0.publisher-name} | insert author {$in.item.developers.0.developer-name} | reject item | save books.csv`
|
|
|
|
- search openlibrary for the book
|
|
`http get https://openlibrary.org/search.json?author=Oliver+Goldman&title=Effective+Software+Architecture | save search_result.json`
|
|
- get isbn from openlibrary (currently first result, primary edition)
|
|
`open search_result.json | get docs.0.cover_edition_key | http get $"https://openlibrary.org/books/($in).json" | save work_result.json`
|
|
- fill out other information from edition info if available
|
|
- publishers
|
|
- publish_date
|
|
- languages
|
|
- authors?
|
|
- title
|
|
- subtitle
|
|
- isbn_13
|
|
- isbn_10 if exists
|
|
- olid (Openlibrary ID) = key above
|
|
|
|
- save it into csv
|
|
- title
|
|
- author_text (First Last, First Last)
|
|
- remote_id (link, nothing)
|
|
- openlibrary_key (olid above)
|
|
- isbn_10
|
|
- isbn_13
|