full text search, what are you using ?

[freecartoonporn]

i am using mysql native full text search. but increased traffic is crashing my mysql., and server load is fucking high too, eben on 64 gig box with ssd.

i used sphinx before on different project and it was pain in the ass, taking my server load to the roof. eating all my cpu.

i heard good things about elasticsearch, but looks difficult to implement.

or is it time to scale horizontally ? and throw more servers., and do master slave replication in mysql.

how many servers does the big sites own ? under 10k alexa sites ?

thanks for your time.

i have around 5 mil records and i only need to search title which is varchar 255 .
why the fuck this shit has to be so difficult for dbms.,

one of these days i am gonna code my own fts search engine.,

[kjs]

just use https://elastic.co

[sarettah]

Originally Posted by freecartoonporn

i have around 5 mil records and i only need to search title which is varchar 255 .
why the fuck this shit has to be so difficult for dbms.,

You would probably be better off NOT using full text search and just using a like statement instead. Full text search has a lot of overhead to it that should not be needed for just a 255 char field.

Do some testing between full text search and using a like statement.

If you can, index the title too.

All strictly imho, of course.

.

[freecartoonporn]

Originally Posted by kjs

just use https://elastic.co

it looks like hosted elastic search.

Originally Posted by sarettah

You would probably be better off NOT using full text search and just using a like statement instead. Full text search has a lot of overhead to it that should not be needed for just a 255 char field.

Do some testing between full text search and using a like statement.

If you can, index the title too.

All strictly imho, of course.

.

nope, full text search has more performance than like queries,

[iceboi]

I use elastic search on 15 million records - 64gb ram and it performs great. The index doesn't need so much ram though. If it's too hard to set up, then go with the hosted version or you can check out algolia but it can get crazy expensive but might be worth it depending on your business model.

[freecartoonporn]

Originally Posted by iceboi

I use elastic search on 15 million records - 64gb ram and it performs great. The index doesn't need so much ram though. If it's too hard to set up, then go with the hosted version or you can check out algolia but it can get crazy expensive but might be worth it depending on your business model.

Thanks

how many hits does your site get ?

or whats the alexa of your site ?

do you have single box for lemp and elastic or separate boxes ?

last time i tried setting up elastic on vps , i got confused in elastic and kibana and logstash., looks like i need to do some reading now.

[freecartoonporn]

okat, installed elasticsearch, playing with it now.,