As an anonymous user, you can only add new data. If you would like to also modify existing data, please create an account and indicate your languages on your user page.

Help talk:Downloading the data

From OmegaWiki
Jump to: navigation, search

Links in this page are not working. Anyone know where to get the data?

Thanks for reporting the problem. I did a fresh install of OmegaWiki 2 days ago and forgot to put the dump folders back.
The links should work again now. --Kip (talk) 22:19, 21 December 2012 (CET)

The "latest" version seems to be just the "lexical" version! Maybe there is an error with the links somewhere in the preparation of the dumps?--Cysouw (talk) 21:40, 6 November 2013 (CET)

From what I can see on the server, they don't have the same size
224M Nov  6 06:32 omegawiki-latest.sql.gz
40M Nov  6 06:29 omegawiki-lexical.sql.gz
So, I am pretty sure that the data is there, but the "omegawiki-latest" is generated by first generating the gzipped lexical dump, and then appending the additional (gzipped) tables to that dump. It can be that the add/merge results in a corrupted sql file.
Did you do an import of the .sql file in your mysql installation, and didn't see the additional tables (e.g. the "page" table)? --Kip (talk) 23:28, 6 November 2013 (CET)

I downloaded the files (just tried it again), and unzipped the "lexical" file is 204MB and the "latest" file is exactly the same size. When I upload them into mysql they look exactly the same. I didn't do any formal identity tests. What I am missing is the actual content about languages and translations of the defined meanings in the "latest" full version. --Cysouw (talk) 10:48, 7 November 2013 (CET)

Wait! Something very strange happens: On my Mac, the browser automatically unzips the files. Now I tried not to automatically unzip them, but do it manual afterwards. Now it looks much better! I'll do more testing in the next few days --Cysouw (talk) 10:56, 7 November 2013 (CET)
The big file is actually 2 zip files concatenated one after the other. I read somewhere that it is supposed to work and generate a correct zip file. Maybe it doesnt work that well after all... I guess your browser stopped at the end of the 1st zip file. I will see if there is somewhere a better manner of merging 2 zip files. --Kip (talk) 11:06, 7 November 2013 (CET)
That seems to be the problem! Automatic unzipping on the mac only retains one of the two files. manual unzipping retains both files, but concatenates them into one sql file. I have to split them (with csplit), and then upload two sql files to the mysql server. Then it works!
But: I still get a rather different structure as described on the help pages on the Database Layout! Did something radically change in the Database? For example, I don't get a "uw_translated_content", nor a "language" table, and various more are not included. --Cysouw (talk) 12:31, 7 November 2013 (CET)
Hmm, this is weird, I'll look into it later. I'll also change how the dumps are generated if this does not work. --Kip (talk) 14:13, 7 November 2013 (CET)
I tried again today, and now it works as intended! I don't know what went wrong the other day. However, I would suggest splitting the 2 files from the "latest" version into separate downloads. thanks for assistance --Cysouw (talk) 16:25, 9 November 2013 (CET)