Posted by: h4ck@lyst | November 28, 2007

wikipedia install.. again:) Uncompressing the dump

Well this is my second wikipedia installation. And this time I guess I ll try and document it step by step as much as possible.

[root@httpd1 wiki]# time bunzip2 enwiki-latest-pages-articles.xml.bz2

real 42m17.283s
user 36m7.756s
sys 2m9.497s
[root@httpd1 wiki]# ll -h
total 13G
-rw-r–r– 1 root root 13G 2007-11-28 21:31 enwiki-latest-pages-articles.xml
[root@httpd1 wiki]# ll
total 13375388
-rw-r–r– 1 root root 13683010813 2007-11-28 21:31 enwiki-latest-pages-articles.xml

Actual size of the bz2 dump

-rw-r–r– 1 root root 3183362146 2007-11-28 21:31 enwiki-latest-pages-articles.xml.bz2
-rw-r–r– 1 root root 3.0G 2007-11-28 21:31 enwiki-latest-pages-articles.xml.bz2

So it took me 42 mins to uncompress it. 🙂 More to follow as and when I get more done.

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Categories

%d bloggers like this: