Dandello Forum AdministratorYaBB Modder Offline I love YaBB 2.7! Posts: 2234 Location: The Land of YaBB Joined: Feb 12th, 2014 Gender: Mood: Annoyed Zodiac sign: Re: Perl Reply #15 - May 21st, 2016 at 9:00pm Mark & QuoteQuote Ahh! a variation on the famous 0 length vars file problem. Perfection is not possible. Excellence, however, is excellent. WWW IP Logged
Monni Language Offline Min izāmō Posts: 413 Location: Kaarina, Finland Joined: Jul 16th, 2014 Gender: Mood: Frustrated Zodiac sign: Re: Perl Reply #16 - May 21st, 2016 at 9:11pm Mark & QuoteQuote Dandello wrote on May 21st, 2016 at 9:00pm:Ahh! a variation on the famous 0 length vars file problem. It can basically happen with any file. I've seen it happen on attachment list file, instant message mailboxes etc... if opening file succeeds but writing doesn't, all data is lost, because it doesn't keep copy of the overwritten data. GTalk Skype/VoIP Facebook Twitter YouTube ICQ IP Logged
Dandello Forum Administrator Offline I love YaBB 2.7! Posts: 2234 Location: The Land of YaBB Joined: Feb 12th, 2014 Gender: Mood: Annoyed Zodiac sign: Re: Perl Reply #17 - May 21st, 2016 at 9:44pm Mark & QuoteQuote Monni wrote on May 21st, 2016 at 9:11pm:if opening file succeeds but writing doesn't, all data is lost, because it doesn't keep copy of the overwritten data. Yet another reason to start seriously looking at mySQL for the data storage. In theory, it's less likely to wipe the data. Perfection is not possible. Excellence, however, is excellent. WWW IP Logged
Monni Language Offline Min izāmō Posts: 413 Location: Kaarina, Finland Joined: Jul 16th, 2014 Gender: Mood: Frustrated Zodiac sign: Re: Perl Reply #18 - May 21st, 2016 at 10:44pm Mark & QuoteQuote Dandello wrote on May 21st, 2016 at 9:44pm:Monni wrote on May 21st, 2016 at 9:11pm:if opening file succeeds but writing doesn't, all data is lost, because it doesn't keep copy of the overwritten data. Yet another reason to start seriously looking at mySQL for the data storage. In theory, it's less likely to wipe the data. I've used SMF which is basically MySQL version of YaBB as it is based on YaBB SE and it had database corruption issues instead... In YaBB we get one or two zero-length files, but when MySQL database gets corrupted, it usually means everything is unreadable. I know MySQL has repair command, but that doesn't always fix corruption successfully. With forum that is over 1 GB in size, that kinda means we would have to shutdown the forum for about 4 hours every week to take synchronized backups of both the attachment files and data moved to MySQL database, and copy them off-site. GTalk Skype/VoIP Facebook Twitter YouTube ICQ IP Logged
Dandello Forum Administrator Offline I love YaBB 2.7! Posts: 2234 Location: The Land of YaBB Joined: Feb 12th, 2014 Gender: Mood: Annoyed Zodiac sign: Re: Perl Reply #19 - May 23rd, 2016 at 2:17pm Mark & QuoteQuote There are large YaBB forums where the 'normal' backup can take 4+ hours. (Like YaBBForum itself.) But the backup issues for SQL based data is something that has to be seriously considered. It does no good to use mySQL for the data if we can't make good and fast backups of that data - and an easy way to restore the data when necessary. Perfection is not possible. Excellence, however, is excellent. WWW IP Logged
Monni Language Offline Min izāmō Posts: 413 Location: Kaarina, Finland Joined: Jul 16th, 2014 Gender: Mood: Frustrated Zodiac sign: Re: Perl Reply #20 - May 24th, 2016 at 11:09am Mark & QuoteQuote Dandello wrote on May 23rd, 2016 at 2:17pm:There are large YaBB forums where the 'normal' backup can take 4+ hours. (Like YaBBForum itself.) But the backup issues for SQL based data is something that has to be seriously considered. It does no good to use mySQL for the data if we can't make good and fast backups of that data - and an easy way to restore the data when necessary. Even if the backup isn't very large, just the time it takes to download the backup off-site is long, because shared hosting plans have limited diskspace and bandwidth and usually can only hold 4-5 backups on-site at most and only if there is no system backup in progress... Incremental backup currently doesn't work so it can't be used to save size of the individual backups... GTalk Skype/VoIP Facebook Twitter YouTube ICQ IP Logged
Dandello Forum Administrator Offline I love YaBB 2.7! Posts: 2234 Location: The Land of YaBB Joined: Feb 12th, 2014 Gender: Mood: Annoyed Zodiac sign: Re: Perl Reply #21 - May 24th, 2016 at 1:25pm Mark & QuoteQuote That's a problem I can't reproduce. HOWEVER, if it IS related to the problem I was having with Advanced Backup, put the if statements back and move Code automaintenance('off'); into 'sub print_BackupSettings' just above the return. Hopefully that will fix the problem(s) with your Backup.pm as I suspect the problems you were having with the if statements had to due with the $max_process_time being set longer than your allowed process time. Perfection is not possible. Excellence, however, is excellent. WWW IP Logged
Monni Language Offline Min izāmō Posts: 413 Location: Kaarina, Finland Joined: Jul 16th, 2014 Gender: Mood: Frustrated Zodiac sign: Re: Perl Reply #22 - May 24th, 2016 at 2:13pm Mark & QuoteQuote Dandello wrote on May 24th, 2016 at 1:25pm:That's a problem I can't reproduce. HOWEVER, if it IS related to the problem I was having with Advanced Backup, put the if statements back and move Code automaintenance('off'); into 'sub print_BackupSettings' just above the return. Hopefully that will fix the problem(s) with your Backup.pm as I suspect the problems you were having with the if statements had to due with the $max_process_time being set longer than your allowed process time. If I put the if statement back, I just get too small backup file... it doesn't contain all of the directories... The problem is that when it fails, it doesn't actually write anything to the file as the external zip command uses temporary files. When doing incremental backups, it just prints "Nothing to do." and browser can't handle that because there is no HTTP headers. If I use internal zip from Perl, I just get croak due to file corruption. GTalk Skype/VoIP Facebook Twitter YouTube ICQ IP Logged
Dandello Forum Administrator Offline I love YaBB 2.7! Posts: 2234 Location: The Land of YaBB Joined: Feb 12th, 2014 Gender: Mood: Annoyed Zodiac sign: Re: Perl Reply #23 - May 24th, 2016 at 2:43pm Mark & QuoteQuote What happens if you choose a different backup method? (Or is a different one not available? I'm thinking your hosts's 'upgrade' trashed more than just YaBB's functionality. Unfortunately, on my testbed I only have Archive Tar and Archive Zip available. I'm assuming nothing of note is showing up in the server error log.) BTW, overly small zip file sizes was one of the problems with Advanced Backup on micro-sized YaBBs until I put the $max_process_time down to 5 seconds or less. Perfection is not possible. Excellence, however, is excellent. WWW IP Logged
Monni Language Offline Min izāmō Posts: 413 Location: Kaarina, Finland Joined: Jul 16th, 2014 Gender: Mood: Frustrated Zodiac sign: Re: Perl Reply #24 - May 24th, 2016 at 5:51pm Mark & QuoteQuote Dandello wrote on May 24th, 2016 at 2:43pm:What happens if you choose a different backup method? (Or is a different one not available? I'm thinking your hosts's 'upgrade' trashed more than just YaBB's functionality. Unfortunately, on my testbed I only have Archive Tar and Archive Zip available. I'm assuming nothing of note is showing up in the server error log.) BTW, overly small zip file sizes was one of the problems with Advanced Backup on micro-sized YaBBs until I put the $max_process_time down to 5 seconds or less. I didn't really test if Archive::Tar was supported because of the timeout issue... I saw no reason to drop $max_process_time further as it always failed on the big directory, not the smaller ones. When it hadn't failed yet, it said the step took 7.3 seconds. GTalk Skype/VoIP Facebook Twitter YouTube ICQ IP Logged