57 Commits

Author	SHA1	Message	Date
pushrbx	a87b4617d0	fixed some issues with IncrementalIndexer	2024-11-08 19:30:00 +00:00
pushrbx	cc5c12ff39	removed "characters" and "people" media types from incremental indexer command	2024-11-05 16:30:41 +00:00
pushrbx	15bd63fdc7	fixed media type choices and url for indexing	2024-11-05 09:30:13 +00:00
pushrbx	6c2d2d3e9d	refactored the code for better readability	2024-11-05 09:25:52 +00:00
pushrbx	e0cc44495b	added incremental indexer	2024-11-04 21:09:21 +00:00
pushrbx	970ff8aad4	removed redundant imports	2024-11-04 21:09:02 +00:00
pushrbx	c9e8f797a1	added sorting of mal ids when indexing entries	2024-01-17 21:54:54 +00:00
pushrbx	309e1d6402	wip - container setup cli and fixed some issues with docker compose yml (still buggy)	2023-10-23 22:19:10 +01:00
pushrbx	6eff2af172	various fixes and refactorings ... - genre filtering - added unapproved filtering - fixed sfw filtering - fixed kids filtering - fixed deprecation warnings as of php 8.1 - DateTime ctor can't take `null` anymore as first param - preg_replace doesn't accept `null` values as `$subject` - fixed failed items indexer (the --failed option of indexers) -- it didn't load the correct file making it impossible to retry the indexing - changed the document schema for search indexed anime/manga - added `approved` field to them - staging will require a reimport into TypeSense - the central filtering system will now process `sfw` and `unapproved` filters, so they will be applied implicitly through the `filter` model scope method.	2023-05-21 11:18:35 +01:00
pushrbx	61af2e0420	fixed the load of failed entries in indexers	2023-05-21 11:18:35 +01:00
pushrbx	431a2fb8f1	fixed scheduler issues when running anime/manga cleanups	2023-05-21 11:18:34 +01:00
Irfan	2f1a7e25ed	Merge branch 'master' into irfan-dahir-patch-1	2023-01-02 11:13:50 +05:00
Irfan	451f38abba	Merge branch 'master' into qol/maintenance-3-12-22	2022-12-25 10:43:08 +05:00
pushrbx	29c524a792	fixed fetching mal ids which is broken with php8.1	2022-12-21 11:19:31 +00:00
Irfan	937f72ac16	adds daily anime & manga sweeper to the schedule	2022-12-13 11:24:11 +05:00
Irfan	a78900fc69	remove unused stuff	2022-12-03 03:04:50 +05:00
Irfan	9689147334	remove old commands	2022-12-03 02:57:00 +05:00
Irfan	8df86920ba	LE	2022-12-03 02:08:19 +05:00
Irfan	c8fe8be6b1	indexers: fix ID merges	2022-10-01 23:52:41 +05:00
Irfan	013030e891	Update AnimeSweepIndexer.php	2022-10-01 23:51:01 +05:00
László GÖRÖG	a6871a31b0	Commands to sweep removed content	2022-08-21 21:53:14 +02:00
Irfan	905fbd9376	ProducersIndexer: bugfix	2022-07-28 01:56:26 +05:00
Irfan	57953676f8	remove unused indexer code	2022-07-28 00:03:59 +05:00
Irfan	a37375aaa6	ProducersIndexer: bug fix resume support	2022-07-27 23:59:27 +05:00
Irfan	a0cc1152f7	add indexer:producer	2022-07-27 23:46:03 +05:00
Irfan	b51c188770	indexer: magazines, producers fix duplication issue	2022-01-06 07:57:30 +05:00
Irfan	d780b0284f	Update GenreIndexer.php	2021-12-27 19:56:18 +05:00
Irfan	5bff12964a	fix genre duplication issue	2021-12-27 19:55:24 +05:00
Irfan	5701af3728	add support and fix genres endpoint	2021-11-13 06:01:39 +05:00
Irfan	01e29b06d5	update & separate genre indexer: indexer:genres	2021-11-13 04:53:39 +05:00
Irfan	f161bcb486	WIP: add insights	2021-09-11 03:39:49 +05:00
Irfan	7676d7f846	Fix indexer:common - bad fingerprints creates new entries instead of updating	2021-07-19 16:03:43 +05:00
Irfan	d294e6797f	improve indexer:anime	2021-07-19 00:00:09 +05:00
Irfan	dbdca67f1e	improve indexer:manga	2021-07-18 23:56:58 +05:00
Irfan	db36edba3c	indexer: bump sleep time between requests to 3 seconds default	2021-07-18 03:41:11 +05:00
Irfan	7500bdec63	console: anime + manga indexer via mal-id-cache	2021-07-18 02:43:31 +05:00
Irfan	37954c1388	Update MicroCaching.php	2021-06-25 02:44:22 +05:00
Irfan	3ff68c4f17	add command microcaching:service {enable/disable}	2021-06-25 02:02:55 +05:00
Irfan	1755b4e5cc	add a current season anime indexer	2021-06-23 10:07:57 +05:00
Irfan	7e016d1fca	Fix API url in scheduler and docs	2021-05-13 12:53:20 +05:00
Irfan	78404faaec	update indexer	2020-11-24 18:53:58 +05:00
Irfan	484610f28c	remove blacklist functionality (broken)	2020-09-13 12:48:49 +05:00
Irfan	542d779204	add command indexer:schedule	2020-09-09 00:32:32 +05:00
Irfan	c03ba8292c	bug fix: common indexer	2020-09-07 04:50:19 +05:00
Irfan	512faa9997	add indexer to schedule	2020-07-14 00:06:49 +05:00
Irfan	249a090451	add initial indexing command for producers, maagazines, genres	2020-07-13 23:43:08 +05:00
Irfan	9f6ee54cc3	add microcaching #66	2019-11-17 21:58:11 -08:00
Irfan	793f4d6372	add etag middleware	2019-11-17 21:17:59 -08:00
Irfan	0bc8339668	update cache remove command	2019-11-15 11:49:19 -08:00
Irfan	f76f6559a0	add blacklist commands ... blacklist:add {ip} {--reload} blacklist:remove {ip} {--reload} blacklist:flush {--reload}	2019-11-15 11:19:36 -08:00