initial commit

README.md

@@ -0,0 +1,42 @@
+# Create a Bookwyrm-ready import list from humble bundle
+
+Usage: `./grab.nu <link-to-humble-book-bundle-page>`
+
+For example: `./grab.nu https://www.humblebundle.com/books/data-engineering-science-oreilly-books | save -f data-eng.csv`
+
+Will download book info in parallel, but often does not find enough info for _all_ books.
+
+## Internal logic
+
+- get humble bundle page
+  `http get https://www.humblebundle.com/books/software-architecture-pearson-books`
+- extract correct element for json data
+  `open out.html | pup "script#webpack-bundle-page-data text{}" | from json`
+
+- get transposed version
+  `open books.json | get bundleData.tier_item_data | transpose machine_id item | insert human_name {$in.item.human_name} | insert cover_art {$in.item.resolved_paths.front_page_art_imgix_retina} | insert publisher {$in.item.publishers.0.publisher-name} | reject item`
+- get details of books into tabled format
+  `open books_transposed.json | where machine_id != "code_org" | insert human_name {$in.item.human_name} | insert cover_art {$in.item.resolved_paths.front_page_art_imgix_retina} | insert publisher {$in.item.publishers.0.publisher-name}  | insert author {$in.item.developers.0.developer-name} | reject item | save books.csv`
+
+- search openlibrary for the book
+  `http get https://openlibrary.org/search.json?author=Oliver+Goldman&title=Effective+Software+Architecture | save search_result.json`
+- get isbn from openlibrary (currently first result, primary edition)
+  `open search_result.json | get docs.0.cover_edition_key | http get $"https://openlibrary.org/books/($in).json" | save work_result.json`
+- fill out other information from edition info if available
+  - publishers
+  - publish_date
+  - languages
+  - authors?
+  - title
+  - subtitle
+  - isbn_13
+  - isbn_10 if exists
+  - olid (Openlibrary ID) = key above
+
+- save it into csv
+  - title
+  - author_text (First Last, First Last)
+  - remote_id (link, nothing)
+  - openlibrary_key (olid above)
+  - isbn_10
+  - isbn_13