Register Members List Search Today's Posts Mark Forums Read

Reply
 
Thread Tools
  #1  
Old 06 Oct 2013, 19:08
katie hunter's Avatar
katie hunter katie hunter is offline
 
Join Date: May 2007
Arrow Sphinx search for vb 4.x?

Hi, I am currently trying to rebuilt my search index after i upgraded to vb 4.x and it is taking so many hours because i have 4+ million posts.

Then i was searching and i came across this Sphinx search. Other than it is hard to integrate, why didn't vb use something like this that will help with big boards which have millions of posts? It seems vb search function is limited in many ways.

Is there a demo for the sphinx search? I couldn't find one so i can see how it looks or work, is it built inside vb search function?

https://marketplace.digitalpoint.com...tin-4.870/item

Performance & Scalability


A rough example of how much resources the default search uses, it took nearly 5 days to index 12M posts with the vB database search. The exact same content took 18 minutes to index with our Sphinx system.
http://www.vbulletin.com/forum/forum...ghlight=sphinx

Is there a faster way to rebuilt search index? The issue i had, is that many of our members could not find results for topics that is already on the forum. I think that is because i never finished rebuilding the forum index.

Currently
Building Search Index Null Type 3008000

Last edited by katie hunter; 06 Oct 2013 at 19:56.
Reply With Quote
  #2  
Old 06 Oct 2013, 23:18
snakes1100 snakes1100 is offline
 
Join Date: Dec 2001
Real name: Anthony
Never seen a demo from Shawn on the Sphinx plugin, you would require ssh access & proper user access in shell to install it on your server.

I would off the vb search as its a pita & slow.

There are obvious restrictions to the Sphinx search due to the vb db design, which will limit your sorting options, which shouldnt really be missed by your users.
Reply With Quote
  #3  
Old 06 Oct 2013, 23:27
katie hunter's Avatar
katie hunter katie hunter is offline
 
Join Date: May 2007
If i have vbseo running, would it not work or conflict with it? since vbseo support is deceased now, so i have no idea
Reply With Quote
  #4  
Old 06 Oct 2013, 23:34
snakes1100 snakes1100 is offline
 
Join Date: Dec 2001
Real name: Anthony
No vbseo isnt a issue.

The new tapatalk also works with shawns plugin as well.
Reply With Quote
  #5  
Old 07 Oct 2013, 05:42
eva2000's Avatar
eva2000 eva2000 is offline
 
Join Date: Oct 2001
no demos but if you google for 'Digital Point modules: Sphinx-based search' the copyright from shawn's sphinx search link you will find vB forums using the plugin and get an idea of how fast search is

it's very fast ! alot of my private clients i setup vb4 digitalpoint sphinx search for and it's blistering fast for forums with up to 60 million posts from my own experience !

it isn't built inside specifically, search and search data are handled by sphinx search which you need to install from sphinxsearch.com on your server (hence why it isn't possible by default out of box - it's server software dependent on you installing and configuring properly sphinx search - just like vB is dependent on working apache, php and mysql setup) and search index data is usually on disk separately, default to /home/sphinx-data if you follow shawn's instructions but can be on any disk partition

edit: just quoting myself

To give you an idea, I installed this vB4 plugin and Sphinx search http://sphinxsearch.com/about/sphinx/ on a 5.5 million post forum. The difference and load compared to default vB4 search is like night and day.

Before
- vB4 default search took around 57-60 seconds to return a common keyword search term of their forums which locks on MySQL tables affecting all other vB members usage of the forums.

After
- Sphinx search + vB4 sphinx plugin installed to replace vB4 default search, the same search term only took 0.18 to 0.30 seconds to return - that's 333x times faster! And without any negative effect for other vB members' experience on the forums.

Also reindexing search (needed create proper indexes for search terms - without this indexing your vB search feature will not return any results), for

- vB4 default search on 5.5 million post forum took around 3-5 days to reindex. Note while reindexing, majority of search keyword terms will not return any results until the keyword term is added to the indexing. So for 3-5 days search will be essentially broken to members not able to search for keyword terms.
- With Sphinx search plugin, it only takes around 10-15 minutes - that's 720x times faster!
__________________

Last edited by eva2000; 07 Oct 2013 at 05:48.
Reply With Quote
  #6  
Old 12 Oct 2013, 15:31
BoyG BoyG is offline
 
Join Date: Jan 2006
Hi Eva, how do you reindex the DP Sphinx Plugin? Do you have a step by step walkthrough? Thanks!
Reply With Quote
  #7  
Old 12 Oct 2013, 16:17
katie hunter's Avatar
katie hunter katie hunter is offline
 
Join Date: May 2007
https://forums.digitalpoint.com/thre...gelog.2628794/
Reply With Quote
  #8  
Old 12 Oct 2013, 20:18
snakes1100 snakes1100 is offline
 
Join Date: Dec 2001
Real name: Anthony
That howto isnt for every system, php's binary isnt always in /usr/local/bin/php, that differs on systems.
Reply With Quote
  #9  
Old 13 Oct 2013, 15:31
eva2000's Avatar
eva2000 eva2000 is offline
 
Join Date: Oct 2001
katie's linked url shows how to manually reindex. Usually for my private clients, I use a simple shell script I wrote that can automatically reindex sphinx search when run.

And yes as Anthony (snakes1100) has stated you will need to make sure correct php binary path is used.
__________________
Reply With Quote
  #10  
Old 28 Apr 2014, 10:20
hostmela hostmela is offline
 
Join Date: Nov 2008
I get bellow error

Command: /usr/local/sphinx/bin/searchd --config /usr/local/sphinx/etc/vbulletin-sphinx.php
Result
Sphinx 2.1.7-id64-release (rel21-r4638)
Copyright (c) 2001-2014, Andrew Aksyonoff
Copyright (c) 2008-2014, Sphinx Technologies Inc (http://sphinxsearch.com)

using config file '/usr/local/sphinx/etc/vbulletin-sphinx.php'...
WARNING: key 'port' is deprecated in /usr/local/sphinx/etc/vbulletin-sphinx.php line 962; use 'listen' instead.
FATAL: port 0 is out of range

Please advise
Reply With Quote
  #11  
Old 06 Oct 2014, 01:35
dany_danay dany_danay is offline
 
Join Date: Jul 2009
My problem is:
root@server:~# /usr/bin/indexer --rotate --all
Sphinx 2.0.10-id64-release (rel20-r4501)
Copyright (c) 2001-2014, Andrew Aksyonoff
Copyright (c) 2008-2014, Sphinx Technologies Inc (http://sphinxsearch.com)

using config file '/etc/sphinxsearch/sphinx.conf'...
indexing index 'forobase'...
ERROR: index 'forobase': key 'path' not found.
indexing index 'foropost1'...
FATAL: failed to open /home/sphinx-data/foropost1.tmp.spl: No such file or directory, will not index. Try --rotate option.
root@server:~# php /usr/local/etc/sphinx.conf
Could not open input file: /usr/local/etc/sphinx.conf
root@server:~# php /usr/etc/sphinx.conf
Could not open input file: /usr/etc/sphinx.conf


Can somene help?
Reply With Quote
  #12  
Old 06 Oct 2014, 02:55
Zachery's Avatar
Zachery Zachery is offline
 
Join Date: Jul 2002
Real name: Zachery Woods
If you purchased sphinxsearch from digitalpoint, he provides support for it last I checked.
__________________
Looking for ImpEx?
Reply With Quote
  #13  
Old 13 Oct 2014, 18:49
dany_danay dany_danay is offline
 
Join Date: Jul 2009
no
Reply With Quote
  #14  
Old 14 Oct 2014, 03:05
Zachery's Avatar
Zachery Zachery is offline
 
Join Date: Jul 2002
Real name: Zachery Woods
No what? You didn't purchase it?
__________________
Looking for ImpEx?
Reply With Quote
  #15  
Old 26 Nov 2014, 19:50
tommythejoat's Avatar
tommythejoat tommythejoat is offline
 
Join Date: Apr 2008
Real name: Tom McIntyre
He only provides support for premium subscribers to his forums.
Reply With Quote
Reply



Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off


New To Site? Need Help?

All times are GMT. The time now is 05:35.

Layout Options | Width: Wide Color: