Page Index Toggle Pages: 1 [2]  ReplyAdd Poll Send Topic
Hot Topic (More than 10 Replies) Perl (Read 7798 times)
 
Paste Member Name in Quick Reply Box Dandello
Forum Administrator
YaBB Modder
*****
Offline


I love YaBB 2.7!

Posts: 2234
Location: The Land of YaBB
Joined: Feb 12th, 2014
Gender: Female
Mood: Annoyed
Zodiac sign: Virgo
Re: Perl
Reply #15 - May 21st, 2016 at 9:00pm
Mark & QuoteQuote  
Ahh! a variation on the famous 0 length vars file problem. Smiley
  

Perfection is not possible. Excellence, however, is excellent.
Back to top
WWW  
IP Logged
 
Paste Member Name in Quick Reply Box Monni
Language
***
Offline


Min izāmō

Posts: 413
Location: Kaarina, Finland
Joined: Jul 16th, 2014
Gender: Male
Mood: Frustrated
Zodiac sign: Pisces
Re: Perl
Reply #16 - May 21st, 2016 at 9:11pm
Mark & QuoteQuote  
Dandello wrote on May 21st, 2016 at 9:00pm:
Ahh! a variation on the famous 0 length vars file problem. Smiley


It can basically happen with any file. I've seen it happen on attachment list file, instant message mailboxes etc... if opening file succeeds but writing doesn't, all data is lost, because it doesn't keep copy of the overwritten data.
  
Back to top
IP Logged
 
Paste Member Name in Quick Reply Box Dandello
Forum Administrator
*****
Offline


I love YaBB 2.7!

Posts: 2234
Location: The Land of YaBB
Joined: Feb 12th, 2014
Gender: Female
Mood: Annoyed
Zodiac sign: Virgo
Re: Perl
Reply #17 - May 21st, 2016 at 9:44pm
Mark & QuoteQuote  
Monni wrote on May 21st, 2016 at 9:11pm:
if opening file succeeds but writing doesn't, all data is lost, because it doesn't keep copy of the overwritten data.
                     

Yet another reason to start seriously looking at mySQL for the data storage. In theory, it's less likely to wipe the data.
  

Perfection is not possible. Excellence, however, is excellent.
Back to top
WWW  
IP Logged
 
Paste Member Name in Quick Reply Box Monni
Language
***
Offline


Min izāmō

Posts: 413
Location: Kaarina, Finland
Joined: Jul 16th, 2014
Gender: Male
Mood: Frustrated
Zodiac sign: Pisces
Re: Perl
Reply #18 - May 21st, 2016 at 10:44pm
Mark & QuoteQuote  
Dandello wrote on May 21st, 2016 at 9:44pm:
Monni wrote on May 21st, 2016 at 9:11pm:
if opening file succeeds but writing doesn't, all data is lost, because it doesn't keep copy of the overwritten data.
                   

Yet another reason to start seriously looking at mySQL for the data storage. In theory, it's less likely to wipe the data.


I've used SMF which is basically MySQL version of YaBB as it is based on YaBB SE and it had database corruption issues instead... In YaBB we get one or two zero-length files, but when MySQL database gets corrupted, it usually means everything is unreadable. I know MySQL has repair command, but that doesn't always fix corruption successfully. With forum that is over 1 GB in size, that kinda means we would have to shutdown the forum for about 4 hours every week to take synchronized backups of both the attachment files and data moved to MySQL database, and copy them off-site.
  
Back to top
IP Logged
 
Paste Member Name in Quick Reply Box Dandello
Forum Administrator
*****
Offline


I love YaBB 2.7!

Posts: 2234
Location: The Land of YaBB
Joined: Feb 12th, 2014
Gender: Female
Mood: Annoyed
Zodiac sign: Virgo
Re: Perl
Reply #19 - May 23rd, 2016 at 2:17pm
Mark & QuoteQuote  
There are large YaBB forums where the 'normal' backup can take 4+ hours. (Like YaBBForum itself.) But the backup issues for SQL based data is something that has to be seriously considered. It does no good to use mySQL for the data if we can't make good and fast backups of that data - and an easy way to restore the data when necessary.
  

Perfection is not possible. Excellence, however, is excellent.
Back to top
WWW  
IP Logged
 
Paste Member Name in Quick Reply Box Monni
Language
***
Offline


Min izāmō

Posts: 413
Location: Kaarina, Finland
Joined: Jul 16th, 2014
Gender: Male
Mood: Frustrated
Zodiac sign: Pisces
Re: Perl
Reply #20 - May 24th, 2016 at 11:09am
Mark & QuoteQuote  
Dandello wrote on May 23rd, 2016 at 2:17pm:
There are large YaBB forums where the 'normal' backup can take 4+ hours. (Like YaBBForum itself.) But the backup issues for SQL based data is something that has to be seriously considered. It does no good to use mySQL for the data if we can't make good and fast backups of that data - and an easy way to restore the data when necessary.


Even if the backup isn't very large, just the time it takes to download the backup off-site is long, because shared hosting plans have limited diskspace and bandwidth and usually can only hold 4-5 backups on-site at most and only if there is no system backup in progress... Incremental backup currently doesn't work so it can't be used to save size of the individual backups...
  
Back to top
IP Logged
 
Paste Member Name in Quick Reply Box Dandello
Forum Administrator
*****
Offline


I love YaBB 2.7!

Posts: 2234
Location: The Land of YaBB
Joined: Feb 12th, 2014
Gender: Female
Mood: Annoyed
Zodiac sign: Virgo
Re: Perl
Reply #21 - May 24th, 2016 at 1:25pm
Mark & QuoteQuote  
That's a problem I can't reproduce. HOWEVER, if it IS related to the problem I was having with Advanced Backup, put the if statements back and move
Code
Select All
automaintenance('off'); 

into 'sub print_BackupSettings' just above the return.

Hopefully that will fix the problem(s) with your Backup.pm as I suspect the problems you were having with the if statements had to due with the $max_process_time being set longer than your allowed process time.

  

Perfection is not possible. Excellence, however, is excellent.
Back to top
WWW  
IP Logged
 
Paste Member Name in Quick Reply Box Monni
Language
***
Offline


Min izāmō

Posts: 413
Location: Kaarina, Finland
Joined: Jul 16th, 2014
Gender: Male
Mood: Frustrated
Zodiac sign: Pisces
Re: Perl
Reply #22 - May 24th, 2016 at 2:13pm
Mark & QuoteQuote  
Dandello wrote on May 24th, 2016 at 1:25pm:
That's a problem I can't reproduce. HOWEVER, if it IS related to the problem I was having with Advanced Backup, put the if statements back and move
Code
Select All
automaintenance('off'); 

into 'sub print_BackupSettings' just above the return.

Hopefully that will fix the problem(s) with your Backup.pm as I suspect the problems you were having with the if statements had to due with the $max_process_time being set longer than your allowed process time.



If I put the if statement back, I just get too small backup file... it doesn't contain all of the directories... The problem is that when it fails, it doesn't actually write anything to the file as the external zip command uses temporary files. When doing incremental backups, it just prints "Nothing to do." and browser can't handle that because there is no HTTP headers. If I use internal zip from Perl, I just get croak due to file corruption.
  
Back to top
IP Logged
 
Paste Member Name in Quick Reply Box Dandello
Forum Administrator
*****
Offline


I love YaBB 2.7!

Posts: 2234
Location: The Land of YaBB
Joined: Feb 12th, 2014
Gender: Female
Mood: Annoyed
Zodiac sign: Virgo
Re: Perl
Reply #23 - May 24th, 2016 at 2:43pm
Mark & QuoteQuote  
What happens if you choose a different backup method? (Or is a different one not available? I'm thinking your hosts's 'upgrade' trashed more than just YaBB's functionality. Unfortunately, on my testbed I only have Archive Tar and Archive Zip available. I'm assuming nothing of note is showing up in the server error log.) BTW, overly small zip file sizes was one of the problems with Advanced Backup on micro-sized YaBBs until I put the $max_process_time down to 5 seconds or less.
  

Perfection is not possible. Excellence, however, is excellent.
Back to top
WWW  
IP Logged
 
Paste Member Name in Quick Reply Box Monni
Language
***
Offline


Min izāmō

Posts: 413
Location: Kaarina, Finland
Joined: Jul 16th, 2014
Gender: Male
Mood: Frustrated
Zodiac sign: Pisces
Re: Perl
Reply #24 - May 24th, 2016 at 5:51pm
Mark & QuoteQuote  
Dandello wrote on May 24th, 2016 at 2:43pm:
What happens if you choose a different backup method? (Or is a different one not available? I'm thinking your hosts's 'upgrade' trashed more than just YaBB's functionality. Unfortunately, on my testbed I only have Archive Tar and Archive Zip available. I'm assuming nothing of note is showing up in the server error log.) BTW, overly small zip file sizes was one of the problems with Advanced Backup on micro-sized YaBBs until I put the $max_process_time down to 5 seconds or less.


I didn't really test if Archive::Tar was supported because of the timeout issue... I saw no reason to drop $max_process_time further as it always failed on the big directory, not the smaller ones. When it hadn't failed yet, it said the step took 7.3 seconds.
  
Back to top
IP Logged
 
Page Index Toggle Pages: 1 [2] 
ReplyAdd Poll Send Topic
Bookmarks: del.icio.us Digg Facebook Google LinkedIn reddit Twitter Yahoo
Perl

Please type the characters exactly as they appear in the image,
without the first 2 and last 2 characters.
The characters must be typed in the same order,
and they are case-sensitive.
Open Preview Preview

You can resize the textbox by dragging the right or bottom border.
Off Topic Comment Insert Spoiler
Insert Hyperlink Insert FTP Link Insert Image Insert E-mail Insert Media Insert Table Insert Table Row Insert Table Column Insert Horizontal Rule Insert Teletype Insert Code Insert Quote Edited Superscript Subscript Insert List /me - my name Insert Marquee Insert Timestamp No Parse
Bold Italicized Underline Insert Strikethrough Highlight
                       
Change Text Color
Insert Preformatted Text Left Align Centered Right Align
resize_wb
resize_hb







Max 5000 characters. Remaining characters:
Text size: %
More Smilies
View All Smilies
Collapse additional features Collapse/Expand additional features Smiley Wink Cheesy Grin Angry Sad Shocked Cool Huh Roll Eyes Tongue Embarrassed Lips Sealed Undecided Kiss Cry