Commit Graph

8 Commits

Author SHA1 Message Date
da3acaaacb Optimize rocksdb 2025-10-26 01:31:57 +08:00
9f6c81471e Add rocksdb 2025-10-26 00:28:24 +08:00
27bee0cfde Add basic dlsite crawler
Reformat application config
2025-10-18 01:32:00 +08:00
fea4e8d35e Change to use json for config
cleanup unused codes
2025-10-17 16:29:36 +08:00
d033d8b93f Reformat code 2025-10-15 21:57:33 +08:00
fromost
6f8a1eada1 change robots.txt to cache 2025-10-09 17:19:04 +08:00
fromost
2556781b45 Fix sqlite db wrong path 2025-10-09 16:56:50 +08:00
d660f25fb1 add robots txt detection 2025-10-09 15:26:36 +08:00