PoExplorer, a new shop indexer

I just released a simple "Shopping cart" allowing you to save items for later :)

Love what you've done man, is great asset in trading

"

enshin wrote:

Love what you've done man, is great asset in trading

Glad you find it useful :)

------------

I'm probably gonna release the search by socket color tonight.

I give it a Try , thanks m8

Just tried it and makes searching so much easier! No idea how you did this but color me impressed =)

Now I just need to find enough currency for those top dps 2h maces.. =/

Thanks for all the work!

just want to say again, this is the best shop indexer!

Hi, very nice job ;)


Is it possible to get some technical details? Like what language did you use, what technique you use for indexing to avoid overwhelming the PoE web server etc?

I wanted to do this too, but there are already multiple sites so it's not worth it, but I am still curious about implementation :)

Thanks guys.

@Balron: Sure! I'm using Ruby on Rails on the back end, mysql as the db, and I index the items in ElasticSearch (<3).
The indexing script is written in Ruby.

I decided to build my own for really stupid reasons ^^, like the fact that I wanted the sockets to be displayed nicely instead of little dots. Plus the fact that I love building websites.

Seriously, indexing the forums is not hitting the servers that much, at all.
I just preload like 20 pages, then go through all the threads (1 request per thread, that's it). Since there are often tons of items per thread, it takes quite a while to go through all of them, verify if they were not already indexed etc, so there is huge (= few seconds) delay between the requests. Nothing compared to just a few users browsing the site I think.

Thanks, interesting info. Never heard about ElasticSearch before :)

It's quite new, compared to similar solutions like Solr, but it is, in my opinion, much better! Big companies like Foursquare, or Soundcloud started using it.