Presentation is loading. Please wait.

Presentation is loading. Please wait.

State of MediaWiki Brion Vibber Wikimedia Foundation, Inc. Wikimania Hacking Days Cambridge, MA August 2, 2006.

Similar presentations


Presentation on theme: "State of MediaWiki Brion Vibber Wikimedia Foundation, Inc. Wikimania Hacking Days Cambridge, MA August 2, 2006."— Presentation transcript:

1 State of MediaWiki Brion Vibber Wikimedia Foundation, Inc. Wikimania Hacking Days Cambridge, MA August 2, 2006

2 MediaWiki Good does most of what we need scales OK Bad Still very bad performance in some places Parser too irregular Good does most of what we need scales OK Bad Still very bad performance in some places Parser too irregular

3

4 Performance Overall performance has been good this year Splitting English database Faster image upload server Better load balancing, caching Keeping number of machines at or ahead of the growth curve Lots of profiling and targeted software work by Tim and Domas Overall performance has been good this year Splitting English database Faster image upload server Better load balancing, caching Keeping number of machines at or ahead of the growth curve Lots of profiling and targeted software work by Tim and Domas

5 Reliability Good enough for free, but not great: Two cluster restarts from power failures early this year Occasional database explosions Occasional panics from death of critical machines Good enough for free, but not great: Two cluster restarts from power failures early this year Occasional database explosions Occasional panics from death of critical machines

6 Reliability possibilities Move from installation scripts + ad hoc updates to ready-to-run system images Consider running critical systems in a virtual environment for easy transplantation to a new physical box (Xen, VMWare) Ensure a standby for large file servers Clarify and improve data backup and recovery procedures Move from installation scripts + ad hoc updates to ready-to-run system images Consider running critical systems in a virtual environment for easy transplantation to a new physical box (Xen, VMWare) Ensure a standby for large file servers Clarify and improve data backup and recovery procedures

7 Full-text search Search performance problems largely eliminated by improving load balancing and adding more machines. Current Lucene search server searches OK, but doesn’t update quickly. Could work to improve it, or replace it... Alternative engines? (sphinx, etc) Better implementations? (open source) Search performance problems largely eliminated by improving load balancing and adding more machines. Current Lucene search server searches OK, but doesn’t update quickly. Could work to improve it, or replace it... Alternative engines? (sphinx, etc) Better implementations? (open source)

8 Cool things to come? Semantic MediaWiki!!!!111one Xapian search? (xapian.org) Wikidata? LiquidThreads? Better video, PDF, DjVu integration? External auth: OpenID / YADIS / A-Select? WYSIWYG? Version review tagging? Automatic vandalism heuristics? Semantic MediaWiki!!!!111one Xapian search? (xapian.org) Wikidata? LiquidThreads? Better video, PDF, DjVu integration? External auth: OpenID / YADIS / A-Select? WYSIWYG? Version review tagging? Automatic vandalism heuristics?


Download ppt "State of MediaWiki Brion Vibber Wikimedia Foundation, Inc. Wikimania Hacking Days Cambridge, MA August 2, 2006."

Similar presentations


Ads by Google