Commit Graph

14 Commits

Author SHA1 Message Date
Val Lorentz abd9edf336 web_cache: Fix SPN error handling
All checks were successful
ci/woodpecker/push/woodpecker Pipeline was successful
2022-09-25 11:22:41 +02:00
Val Lorentz 1eb169ee6c Add optional support for the authenticated SPN API
All checks were successful
ci/woodpecker/push/woodpecker Pipeline was successful
It has much higher rate limits.
2022-09-25 11:18:13 +02:00
Val Lorentz 1db60954d6 Save pages returned by Save Page Now
All checks were successful
ci/woodpecker/push/woodpecker Pipeline was successful
This is especially useful as pages freshly archived by SPN are not
immediately shown as available by the Wayback Machine API, so we
may send a pointless SPN request right after
2022-09-24 22:43:34 +02:00
Val Lorentz 8139bf5410 Fix crash in Save Page Now, when run without mocks 2022-09-24 22:37:22 +02:00
Val Lorentz 9782ec22ec Add a CLI to initialize the database. 2022-09-24 22:30:25 +02:00
Val Lorentz 6f022e5f05 web_cache: Initialize module
All checks were successful
ci/woodpecker/push/woodpecker Pipeline was successful
With support for fetching from the IA and caching in the local DB.
2022-09-20 21:41:07 +02:00
Val Lorentz 5f3e9d6225 db: Add tests for get_last_web_page_snapshot. 2022-09-20 21:31:30 +02:00
Val Lorentz 13ca40eaf7 orm: Refactor INDEX generation
All checks were successful
ci/woodpecker/push/woodpecker Pipeline was successful
2022-09-20 21:31:10 +02:00
Val Lorentz 826c6f73f1 orm: Add SELECT generation
All checks were successful
ci/woodpecker/push/woodpecker Pipeline was successful
2022-09-20 21:28:34 +02:00
Val Lorentz 8abf869c13 Add column 'retrieved_by' to web_page_snapshot
All checks were successful
ci/woodpecker/push/woodpecker Pipeline was successful
2022-09-18 19:41:26 +02:00
Val Lorentz 95fcb043e8 Initialize with a simple ORM and database to store webpage snapshots
All checks were successful
ci/woodpecker/pr/woodpecker Pipeline was successful
ci/woodpecker/push/woodpecker Pipeline was successful
2022-09-17 23:58:57 +02:00
Val Lorentz 671112566f add more linting, give up on py3.7
All checks were successful
ci/woodpecker/pr/woodpecker Pipeline was successful
ci/woodpecker/push/woodpecker Pipeline was successful
2022-09-17 23:40:59 +02:00
val efe3aaccd4 Initialize boilerplate (#1)
All checks were successful
ci/woodpecker/push/woodpecker Pipeline was successful
Co-authored-by: Val Lorentz <progval+opdb@progval.net>
Reviewed-on: #1
2022-09-14 16:33:41 +00:00
val beec4da821 Initial commit 2022-09-14 14:47:02 +00:00