I have tried importing data from an access log (which uses a customized format) containing data for one week, sept. 21 to sept. 28 (almost 1 month ago).
Since the log file is big (900M), I tried first using a 3 line sample - and it seemed to work: I got 2 page views.
Then I tried to import the big log file.
The time taken for import was going to be quite big, as the average number of rows processed was about 30/seconds.
Halfway through the night the ssh connection got closed, and the python script most likely crashed.
Looking at the web interface this morning, all I can see is still only 2 page views.
I tried dropping all archive tables and regenerating reports, but I see no difference.
Note: there is no piwik tracker on the site.
If I look at table size, the action, visit, and visit_action tables all contain many million rows.
Is there any reason for the data not showing up? Any tip for fixing this?
Thanks
Gaetano
Since the log file is big (900M), I tried first using a 3 line sample - and it seemed to work: I got 2 page views.
Then I tried to import the big log file.
The time taken for import was going to be quite big, as the average number of rows processed was about 30/seconds.
Halfway through the night the ssh connection got closed, and the python script most likely crashed.
Looking at the web interface this morning, all I can see is still only 2 page views.
I tried dropping all archive tables and regenerating reports, but I see no difference.
Note: there is no piwik tracker on the site.
If I look at table size, the action, visit, and visit_action tables all contain many million rows.
Is there any reason for the data not showing up? Any tip for fixing this?
Thanks
Gaetano
