Re: [WebDNA] backup / mirror website & databases
This WebDNA talk-list message is from 2018
It keeps the original formatting.
numero = 114192
interpreted = N
texte = 1795 Well, I=E2=80=99m not a genius when it comes to server plans, but here are m= y thoughts... In general I don=E2=80=99t see any problems with that plan oth= er than i don=E2=80=99t think it=E2=80=99s quite standard practice and maybe= a little unnecessarily complicated?? However, if ensuring that you don=E2=80= =99t lose more than an hours activity is your main goal, maybe you have righ= t idea.=20 I=E2=80=99m a big fan of hypervization.. for one reason mainly.. snapshots.= So, here is an alternative idea: RAID 5 (or whatever raid you prefer) Hypervisor os running on extra SSD.=20 Nightly snapshots Daily backups (then whatever longer-term and/or offsite strategies you decid= e) Then you could look into VM replication options of the specific hypervizer y= ou are using(to possibly address the shorter period of loss of data). That last part I don=E2=80=99t know much about... but remember, if you are b= acking stuff up every hour, cracked files will get copied over to... so in t= he event of not catching a crack in time, having a second cracked server won= =E2=80=99t help much. It=E2=80=99s nice to have a series of (one-button) snapshots.. over a length= of time (fitting in with your backup strategy), to fall back on if needed.=20= You could bypass the complicated replication part and do more snapshots... b= ut the creation of them does impede on performance.=20 D. Brooke Mobile > On Apr 19, 2018, at 4:36 PM, webdna
wro= te: >=20 > Hi Donovan, >=20 > In the past I've had 2 physical servers running. A primary and a backup. T= hey were joined by Gluster so that in the event the primary went down for so= me reason the backup took over without the need of downtime to restore from t= he last nightly backup that would be missing current days activity. >=20 > My 2 most powerful servers (16GB RAM & dual quad core processors) are gett= ing old. I've recently upgraded drives to SSD's, replaced power supplies an= d batteries. I want to only have 1 powered up and the other to be a cold spa= re. >=20 > I want to run 2 virutal web servers running on one physical server. One se= rving to the public and the other running and be an up to date copy and in t= he event something such as a hack occurred on the primary virtual server whe= re I could just change the IP address in the router to send all web traffic t= o the backup server's IP. >=20 > I would like to have rsync run once every hour so the process time will be= minimal and the most data that would be lost would be the last hour. Then a= fter the 1:00AM rsync have a script create a tar backup file of the director= ies and databases located on the backup server to a directory on a NAS as th= e days backup. >=20 > Do you see any issues with this? >=20 > Thanks, > Steve >=20 >=20 >=20 >=20 >=20 >> On 04/19/2018 01:38 PM, Donovan Brooke wrote: >> It shouldn=E2=80=99t be necessary... but i think ultimately it depends on= your setup. If you are doing =E2=80=9Calmost real-time=E2=80=9D backups, th= eir could be a performance impact, and at that point, you may want to consid= er RAID. Is there a reason you need =E2=80=9Creal-time=E2=80=9D backups? >>=20 >> D. Brooke Mobile >>=20 >>> On Apr 19, 2018, at 12:03 PM, webdna w= rote: >>>=20 >>> Hi Donovan, >>>=20 >>> I've been using rsync but the guy who used to help me with my servers in= sisted I had to stop webdna first so the databases were not being written to= and then run rsync. Once files were synced DNA was restarted. Is it not nec= essary to stop WebDNA during the sync process ? >>>=20 >>> Also, could you comment on this: >>>> In the "User Submitted Tips & Tricks" section there is an example to >>>> backup databases by a simple [COPYFILE]: >>>> http://www.webdna.us/page.dna?numero=3D54 >>>> ?? Does the example Lock the databases while being copied or is it >>>> assumed the databases are not currently in use? >>> Thanks! >>>=20 >>>=20 >>>> On 04/19/2018 10:59 AM, dbrooke@euca.us wrote: >>>> If all you want is a backup, One option is an RSYNC script. >>>>=20 >>>> =46rom the man page: >>>> DESCRIPTION >>>> Rsync is a fast and extraordinarily versatile file copying t= ool. It can copy locally, to/from another host over any remote shell, or >>>> to/from a remote rsync daemon. It offers a large number of opti= ons that control every aspect of its behavior and permit very flexible >>>> specification of the set of files to be copied. It is famou= s for its delta-transfer algorithm, which reduces the amount of data sent >>>> over the network by sending only the differences between the sou= rce files and the existing files in the destination. Rsync is widely >>>> used for backups and mirroring and as an improved copy command f= or everyday use. >>>>=20 >>>> Rsync finds files that need to be transferred using a "quick che= ck" algorithm (by default) that looks for files that have changed in size >>>> or in last-modified time. Any changes in the other preserved at= tributes (as requested by options) are made on the destination file >>>> directly when the quick check indicates that the file=E2=80=99s d= ata does not need to be updated. >>>>=20 >>>>=20 >>>> There are other paid versions of backup utilities, but this one is free= .. >>>>=20 >>>> Donovan >>>>=20 >>>>=20 >>>>=20 >>>>> On 2018-04-18 19:11, webdna wrote: >>>>> Hi All, >>>>>=20 >>>>> Looking for suggestions to backup and/or mirror website and WebDNA >>>>> databases in real time if possible. >>>>>=20 >>>>> In the "User Submitted Tips & Tricks" section there is an example to >>>>> backup databases by a simple [COPYFILE]: >>>>> http://www.webdna.us/page.dna?numero=3D54 >>>>> ?? Does the example Lock the databases while being copied or is it >>>>> assumed the databases are not currently in use? >>>>>=20 >>>>> I've previously had 2 physical servers running using Gluster in our >>>>> DMZ. I want to only have one physical machine running and having >>>>> backups or synched copies of the site and databases reside on a NAS or= >>>>> a server within our LAN. >>>>>=20 >>>>> Thanks! >>>> --------------------------------------------------------- >>>> This message is sent to you because you are subscribed to >>>> the mailing list talk@webdna.us >>>> To unsubscribe, E-mail to: talk-leave@webdna.us >>>> archives: http://www.webdna.us/page.dna?numero=3D55 >>>> Bug Reporting: support@webdna.us >>> --=20 >>> Steve Raslevich >>> --------------------------------------------------------- >>> This message is sent to you because you are subscribed to >>> the mailing list talk@webdna.us >>> To unsubscribe, E-mail to: talk-leave@webdna.us >>> archives: http://www.webdna.us/page.dna?numero=3D55 >>> Bug Reporting: support@webdna.us >> --------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list talk@webdna.us >> To unsubscribe, E-mail to: talk-leave@webdna.us >> archives: http://www.webdna.us/page.dna?numero=3D55 >> Bug Reporting: support@webdna.us >=20 > --------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list talk@webdna.us > To unsubscribe, E-mail to: talk-leave@webdna.us > archives: http://www.webdna.us/page.dna?numero=3D55 > Bug Reporting: support@webdna.us --------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list talk@webdna.us To unsubscribe, E-mail to: talk-leave@webdna.us archives: http://www.webdna.us/page.dna?numero=3D55 Bug Reporting: support@webdna.us .
Associated Messages, from the most recent to the oldest:
1795 Well, I=E2=80=99m not a genius when it comes to server plans, but here are m= y thoughts... In general I don=E2=80=99t see any problems with that plan oth= er than i don=E2=80=99t think it=E2=80=99s quite standard practice and maybe= a little unnecessarily complicated?? However, if ensuring that you don=E2=80= =99t lose more than an hours activity is your main goal, maybe you have righ= t idea.=20 I=E2=80=99m a big fan of hypervization.. for one reason mainly.. snapshots.= So, here is an alternative idea: RAID 5 (or whatever raid you prefer) Hypervisor os running on extra SSD.=20 Nightly snapshots Daily backups (then whatever longer-term and/or offsite strategies you decid= e) Then you could look into VM replication options of the specific hypervizer y= ou are using(to possibly address the shorter period of loss of data). That last part I don=E2=80=99t know much about... but remember, if you are b= acking stuff up every hour, cracked files will get copied over to... so in t= he event of not catching a crack in time, having a second cracked server won= =E2=80=99t help much. It=E2=80=99s nice to have a series of (one-button) snapshots.. over a length= of time (fitting in with your backup strategy), to fall back on if needed.=20= You could bypass the complicated replication part and do more snapshots... b= ut the creation of them does impede on performance.=20 D. Brooke Mobile > On Apr 19, 2018, at 4:36 PM, webdna wro= te: >=20 > Hi Donovan, >=20 > In the past I've had 2 physical servers running. A primary and a backup. T= hey were joined by Gluster so that in the event the primary went down for so= me reason the backup took over without the need of downtime to restore from t= he last nightly backup that would be missing current days activity. >=20 > My 2 most powerful servers (16GB RAM & dual quad core processors) are gett= ing old. I've recently upgraded drives to SSD's, replaced power supplies an= d batteries. I want to only have 1 powered up and the other to be a cold spa= re. >=20 > I want to run 2 virutal web servers running on one physical server. One se= rving to the public and the other running and be an up to date copy and in t= he event something such as a hack occurred on the primary virtual server whe= re I could just change the IP address in the router to send all web traffic t= o the backup server's IP. >=20 > I would like to have rsync run once every hour so the process time will be= minimal and the most data that would be lost would be the last hour. Then a= fter the 1:00AM rsync have a script create a tar backup file of the director= ies and databases located on the backup server to a directory on a NAS as th= e days backup. >=20 > Do you see any issues with this? >=20 > Thanks, > Steve >=20 >=20 >=20 >=20 >=20 >> On 04/19/2018 01:38 PM, Donovan Brooke wrote: >> It shouldn=E2=80=99t be necessary... but i think ultimately it depends on= your setup. If you are doing =E2=80=9Calmost real-time=E2=80=9D backups, th= eir could be a performance impact, and at that point, you may want to consid= er RAID. Is there a reason you need =E2=80=9Creal-time=E2=80=9D backups? >>=20 >> D. Brooke Mobile >>=20 >>> On Apr 19, 2018, at 12:03 PM, webdna w= rote: >>>=20 >>> Hi Donovan, >>>=20 >>> I've been using rsync but the guy who used to help me with my servers in= sisted I had to stop webdna first so the databases were not being written to= and then run rsync. Once files were synced DNA was restarted. Is it not nec= essary to stop WebDNA during the sync process ? >>>=20 >>> Also, could you comment on this: >>>> In the "User Submitted Tips & Tricks" section there is an example to >>>> backup databases by a simple [copyfile]: >>>> http://www.webdna.us/page.dna?numero=3D54 >>>> ?? Does the example Lock the databases while being copied or is it >>>> assumed the databases are not currently in use? >>> Thanks! >>>=20 >>>=20 >>>> On 04/19/2018 10:59 AM, dbrooke@euca.us wrote: >>>> If all you want is a backup, One option is an RSYNC script. >>>>=20 >>>> =46rom the man page: >>>> DESCRIPTION >>>> Rsync is a fast and extraordinarily versatile file copying t= ool. It can copy locally, to/from another host over any remote shell, or >>>> to/from a remote rsync daemon. It offers a large number of opti= ons that control every aspect of its behavior and permit very flexible >>>> specification of the set of files to be copied. It is famou= s for its delta-transfer algorithm, which reduces the amount of data sent >>>> over the network by sending only the differences between the sou= rce files and the existing files in the destination. Rsync is widely >>>> used for backups and mirroring and as an improved copy command f= or everyday use. >>>>=20 >>>> Rsync finds files that need to be transferred using a "quick che= ck" algorithm (by default) that looks for files that have changed in size >>>> or in last-modified time. Any changes in the other preserved at= tributes (as requested by options) are made on the destination file >>>> directly when the quick check indicates that the file=E2=80=99s d= ata does not need to be updated. >>>>=20 >>>>=20 >>>> There are other paid versions of backup utilities, but this one is free= .. >>>>=20 >>>> Donovan >>>>=20 >>>>=20 >>>>=20 >>>>> On 2018-04-18 19:11, webdna wrote: >>>>> Hi All, >>>>>=20 >>>>> Looking for suggestions to backup and/or mirror website and WebDNA >>>>> databases in real time if possible. >>>>>=20 >>>>> In the "User Submitted Tips & Tricks" section there is an example to >>>>> backup databases by a simple [copyfile]: >>>>> http://www.webdna.us/page.dna?numero=3D54 >>>>> ?? Does the example Lock the databases while being copied or is it >>>>> assumed the databases are not currently in use? >>>>>=20 >>>>> I've previously had 2 physical servers running using Gluster in our >>>>> DMZ. I want to only have one physical machine running and having >>>>> backups or synched copies of the site and databases reside on a NAS or= >>>>> a server within our LAN. >>>>>=20 >>>>> Thanks! >>>> --------------------------------------------------------- >>>> This message is sent to you because you are subscribed to >>>> the mailing list talk@webdna.us >>>> To unsubscribe, E-mail to: talk-leave@webdna.us >>>> archives: http://www.webdna.us/page.dna?numero=3D55 >>>> Bug Reporting: support@webdna.us >>> --=20 >>> Steve Raslevich >>> --------------------------------------------------------- >>> This message is sent to you because you are subscribed to >>> the mailing list talk@webdna.us >>> To unsubscribe, E-mail to: talk-leave@webdna.us >>> archives: http://www.webdna.us/page.dna?numero=3D55 >>> Bug Reporting: support@webdna.us >> --------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list talk@webdna.us >> To unsubscribe, E-mail to: talk-leave@webdna.us >> archives: http://www.webdna.us/page.dna?numero=3D55 >> Bug Reporting: support@webdna.us >=20 > --------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list talk@webdna.us > To unsubscribe, E-mail to: talk-leave@webdna.us > archives: http://www.webdna.us/page.dna?numero=3D55 > Bug Reporting: support@webdna.us --------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list talk@webdna.us To unsubscribe, E-mail to: talk-leave@webdna.us archives: http://www.webdna.us/page.dna?numero=3D55 Bug Reporting: support@webdna.us .
Donovan Brooke
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
when is date system date or order date? (1997)
Malformed Pages (1999)
date display (1999)
Slow applescript context ... (2000)
trouble updating records in database (1998)
mod_webcatalog2.so (2003)
WebMerchant Process Orders errors (2000)
The word TYPE in search contexts and fields (1998)
WebCat2 beta 11 - new prefs ... (1997)
(1997)
Answer: WebDelivery downloads alias, not original ? (1997)
Emailer again (1997)
Delete Context - to remove record (1998)
Documentation Feedback (1997)
Error Lob.db records error message not name (1997)
multi-paragraph fields (1997)
Cart doesn't interpret tag! (1997)
[WebDNA] JSONStore Levels (2020)
UPPERCASE (1997)
triggers.db (1999)