#1 looking to index about 1.000.000 Pages by BIgbot 08.01.2018 13:56

avatar

looking to index about 1.000.000 Pages a day.
So I need a really scalable solution...
Any ideas?

#2 RE: looking to index about 1.000.000 Pages by NixonInnes 08.01.2018 14:07

Following this thread

#3 RE: looking to index about 1.000.000 Pages by nightf0x 12.01.2018 06:31

@BIgbot why don't you get the like 500 - 1000 pages indexed and leave the rest to google. Is it a mass page site?

Xobor Create your own Forum with Xobor