Re: [WebDNA] backup / mirror website & databases
This WebDNA talk-list message is from 2018
It keeps the original formatting.
numero = 114193
interpreted = N
texte = 1796 Donovan, thanks for your suggestions!=C2=A0 Greatly appreciated. Steve On 04/19/2018 11:39 PM, Donovan Brooke wrote: > Well, I=E2=80=99m not a genius when it comes to server plans, but here = are my thoughts... In general I don=E2=80=99t see any problems with that = plan other than i don=E2=80=99t think it=E2=80=99s quite standard practic= e and maybe a little unnecessarily complicated?? However, if ensuring tha= t you don=E2=80=99t lose more than an hours activity is your main goal, m= aybe you have right idea. > > I=E2=80=99m a big fan of hypervization.. for one reason mainly.. snaps= hots. So, here is an alternative idea: > > RAID 5 (or whatever raid you prefer) > > Hypervisor os running on extra SSD. > > Nightly snapshots > > Daily backups (then whatever longer-term and/or offsite strategies you = decide) > > Then you could look into VM replication options of the specific hypervi= zer you are using(to possibly address the shorter period of loss of data= ). > > That last part I don=E2=80=99t know much about... but remember, if you = are backing stuff up every hour, cracked files will get copied over to...= so in the event of not catching a crack in time, having a second cracked= server won=E2=80=99t help much. > > It=E2=80=99s nice to have a series of (one-button) snapshots.. over a l= ength of time (fitting in with your backup strategy), to fall back on if = needed. > > You could bypass the complicated replication part and do more snapshots= .... but the creation of them does impede on performance. > > > D. Brooke Mobile > >> On Apr 19, 2018, at 4:36 PM, webdna
= wrote: >> >> Hi Donovan, >> >> In the past I've had 2 physical servers running. A primary and a backu= p. They were joined by Gluster so that in the event the primary went down= for some reason the backup took over without the need of downtime to res= tore from the last nightly backup that would be missing current days acti= vity. >> >> My 2 most powerful servers (16GB RAM & dual quad core processors) are = getting old. I've recently upgraded drives to SSD's, replaced power supp= lies and batteries. I want to only have 1 powered up and the other to be = a cold spare. >> >> I want to run 2 virutal web servers running on one physical server. On= e serving to the public and the other running and be an up to date copy a= nd in the event something such as a hack occurred on the primary virtual = server where I could just change the IP address in the router to send all= web traffic to the backup server's IP. >> >> I would like to have rsync run once every hour so the process time wil= l be minimal and the most data that would be lost would be the last hour.= Then after the 1:00AM rsync have a script create a tar backup file of th= e directories and databases located on the backup server to a directory o= n a NAS as the days backup. >> >> Do you see any issues with this? >> >> Thanks, >> Steve >> >> >> >> >> >>> On 04/19/2018 01:38 PM, Donovan Brooke wrote: >>> It shouldn=E2=80=99t be necessary... but i think ultimately it depend= s on your setup. If you are doing =E2=80=9Calmost real-time=E2=80=9D back= ups, their could be a performance impact, and at that point, you may want= to consider RAID. Is there a reason you need =E2=80=9Creal-time=E2=80=9D= backups? >>> >>> D. Brooke Mobile >>> >>>> On Apr 19, 2018, at 12:03 PM, webdna wrote: >>>> >>>> Hi Donovan, >>>> >>>> I've been using rsync but the guy who used to help me with my server= s insisted I had to stop webdna first so the databases were not being wri= tten to and then run rsync. Once files were synced DNA was restarted. Is = it not necessary to stop WebDNA during the sync process ? >>>> >>>> Also, could you comment on this: >>>>> In the "User Submitted Tips & Tricks" section there is an example t= o >>>>> backup databases by a simple [COPYFILE]: >>>>> http://www.webdna.us/page.dna?numero=3D54 >>>>> ?? Does the example Lock the databases while being copied or is it >>>>> assumed the databases are not currently in use? >>>> Thanks! >>>> >>>> >>>>> On 04/19/2018 10:59 AM, dbrooke@euca.us wrote: >>>>> If all you want is a backup, One option is an RSYNC script. >>>>> >>>>> From the man page: >>>>> DESCRIPTION >>>>> Rsync is a fast and extraordinarily versatile file copy= ing tool. It can copy locally, to/from another host over any remote shel= l, or >>>>> to/from a remote rsync daemon. It offers a large number of= options that control every aspect of its behavior and permit very flex= ible >>>>> specification of the set of files to be copied. It is = famous for its delta-transfer algorithm, which reduces the amount of data= sent >>>>> over the network by sending only the differences between th= e source files and the existing files in the destination. Rsync is wid= ely >>>>> used for backups and mirroring and as an improved copy comm= and for everyday use. >>>>> >>>>> Rsync finds files that need to be transferred using a "quic= k check" algorithm (by default) that looks for files that have changed in= size >>>>> or in last-modified time. Any changes in the other preserv= ed attributes (as requested by options) are made on the destination = file >>>>> directly when the quick check indicates that the file=E2=80= =99s data does not need to be updated. >>>>> >>>>> >>>>> There are other paid versions of backup utilities, but this one is = free. >>>>> >>>>> Donovan >>>>> >>>>> >>>>> >>>>>> On 2018-04-18 19:11, webdna wrote: >>>>>> Hi All, >>>>>> >>>>>> Looking for suggestions to backup and/or mirror website and WebDNA >>>>>> databases in real time if possible. >>>>>> >>>>>> In the "User Submitted Tips & Tricks" section there is an example = to >>>>>> backup databases by a simple [COPYFILE]: >>>>>> http://www.webdna.us/page.dna?numero=3D54 >>>>>> ?? Does the example Lock the databases while being copied or is it >>>>>> assumed the databases are not currently in use? >>>>>> >>>>>> I've previously had 2 physical servers running using Gluster in ou= r >>>>>> DMZ. I want to only have one physical machine running and having >>>>>> backups or synched copies of the site and databases reside on a NA= S or >>>>>> a server within our LAN. >>>>>> >>>>>> Thanks! >>>>> --------------------------------------------------------- >>>>> This message is sent to you because you are subscribed to >>>>> the mailing list talk@webdna.us >>>>> To unsubscribe, E-mail to: talk-leave@webdna.us >>>>> archives: http://www.webdna.us/page.dna?numero=3D55 >>>>> Bug Reporting: support@webdna.us >>>> --=20 >>>> Steve Raslevich >>>> --------------------------------------------------------- >>>> This message is sent to you because you are subscribed to >>>> the mailing list talk@webdna.us >>>> To unsubscribe, E-mail to: talk-leave@webdna.us >>>> archives: http://www.webdna.us/page.dna?numero=3D55 >>>> Bug Reporting: support@webdna.us >>> --------------------------------------------------------- >>> This message is sent to you because you are subscribed to >>> the mailing list talk@webdna.us >>> To unsubscribe, E-mail to: talk-leave@webdna.us >>> archives: http://www.webdna.us/page.dna?numero=3D55 >>> Bug Reporting: support@webdna.us >> --------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list talk@webdna.us >> To unsubscribe, E-mail to: talk-leave@webdna.us >> archives: http://www.webdna.us/page.dna?numero=3D55 >> Bug Reporting: support@webdna.us > --------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list talk@webdna.us > To unsubscribe, E-mail to: talk-leave@webdna.us > archives: http://www.webdna.us/page.dna?numero=3D55 > Bug Reporting: support@webdna.us --=20 Steve Raslevich --------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list talk@webdna.us To unsubscribe, E-mail to: talk-leave@webdna.us archives: http://www.webdna.us/page.dna?numero=3D55 Bug Reporting: support@webdna.us .
Associated Messages, from the most recent to the oldest:
1796 Donovan, thanks for your suggestions!=C2=A0 Greatly appreciated. Steve On 04/19/2018 11:39 PM, Donovan Brooke wrote: > Well, I=E2=80=99m not a genius when it comes to server plans, but here = are my thoughts... In general I don=E2=80=99t see any problems with that = plan other than i don=E2=80=99t think it=E2=80=99s quite standard practic= e and maybe a little unnecessarily complicated?? However, if ensuring tha= t you don=E2=80=99t lose more than an hours activity is your main goal, m= aybe you have right idea. > > I=E2=80=99m a big fan of hypervization.. for one reason mainly.. snaps= hots. So, here is an alternative idea: > > RAID 5 (or whatever raid you prefer) > > Hypervisor os running on extra SSD. > > Nightly snapshots > > Daily backups (then whatever longer-term and/or offsite strategies you = decide) > > Then you could look into VM replication options of the specific hypervi= zer you are using(to possibly address the shorter period of loss of data= ). > > That last part I don=E2=80=99t know much about... but remember, if you = are backing stuff up every hour, cracked files will get copied over to...= so in the event of not catching a crack in time, having a second cracked= server won=E2=80=99t help much. > > It=E2=80=99s nice to have a series of (one-button) snapshots.. over a l= ength of time (fitting in with your backup strategy), to fall back on if = needed. > > You could bypass the complicated replication part and do more snapshots= .... but the creation of them does impede on performance. > > > D. Brooke Mobile > >> On Apr 19, 2018, at 4:36 PM, webdna = wrote: >> >> Hi Donovan, >> >> In the past I've had 2 physical servers running. A primary and a backu= p. They were joined by Gluster so that in the event the primary went down= for some reason the backup took over without the need of downtime to res= tore from the last nightly backup that would be missing current days acti= vity. >> >> My 2 most powerful servers (16GB RAM & dual quad core processors) are = getting old. I've recently upgraded drives to SSD's, replaced power supp= lies and batteries. I want to only have 1 powered up and the other to be = a cold spare. >> >> I want to run 2 virutal web servers running on one physical server. On= e serving to the public and the other running and be an up to date copy a= nd in the event something such as a hack occurred on the primary virtual = server where I could just change the IP address in the router to send all= web traffic to the backup server's IP. >> >> I would like to have rsync run once every hour so the process time wil= l be minimal and the most data that would be lost would be the last hour.= Then after the 1:00AM rsync have a script create a tar backup file of th= e directories and databases located on the backup server to a directory o= n a NAS as the days backup. >> >> Do you see any issues with this? >> >> Thanks, >> Steve >> >> >> >> >> >>> On 04/19/2018 01:38 PM, Donovan Brooke wrote: >>> It shouldn=E2=80=99t be necessary... but i think ultimately it depend= s on your setup. If you are doing =E2=80=9Calmost real-time=E2=80=9D back= ups, their could be a performance impact, and at that point, you may want= to consider RAID. Is there a reason you need =E2=80=9Creal-time=E2=80=9D= backups? >>> >>> D. Brooke Mobile >>> >>>> On Apr 19, 2018, at 12:03 PM, webdna wrote: >>>> >>>> Hi Donovan, >>>> >>>> I've been using rsync but the guy who used to help me with my server= s insisted I had to stop webdna first so the databases were not being wri= tten to and then run rsync. Once files were synced DNA was restarted. Is = it not necessary to stop WebDNA during the sync process ? >>>> >>>> Also, could you comment on this: >>>>> In the "User Submitted Tips & Tricks" section there is an example t= o >>>>> backup databases by a simple [copyfile]: >>>>> http://www.webdna.us/page.dna?numero=3D54 >>>>> ?? Does the example Lock the databases while being copied or is it >>>>> assumed the databases are not currently in use? >>>> Thanks! >>>> >>>> >>>>> On 04/19/2018 10:59 AM, dbrooke@euca.us wrote: >>>>> If all you want is a backup, One option is an RSYNC script. >>>>> >>>>> From the man page: >>>>> DESCRIPTION >>>>> Rsync is a fast and extraordinarily versatile file copy= ing tool. It can copy locally, to/from another host over any remote shel= l, or >>>>> to/from a remote rsync daemon. It offers a large number of= options that control every aspect of its behavior and permit very flex= ible >>>>> specification of the set of files to be copied. It is = famous for its delta-transfer algorithm, which reduces the amount of data= sent >>>>> over the network by sending only the differences between th= e source files and the existing files in the destination. Rsync is wid= ely >>>>> used for backups and mirroring and as an improved copy comm= and for everyday use. >>>>> >>>>> Rsync finds files that need to be transferred using a "quic= k check" algorithm (by default) that looks for files that have changed in= size >>>>> or in last-modified time. Any changes in the other preserv= ed attributes (as requested by options) are made on the destination = file >>>>> directly when the quick check indicates that the file=E2=80= =99s data does not need to be updated. >>>>> >>>>> >>>>> There are other paid versions of backup utilities, but this one is = free. >>>>> >>>>> Donovan >>>>> >>>>> >>>>> >>>>>> On 2018-04-18 19:11, webdna wrote: >>>>>> Hi All, >>>>>> >>>>>> Looking for suggestions to backup and/or mirror website and WebDNA >>>>>> databases in real time if possible. >>>>>> >>>>>> In the "User Submitted Tips & Tricks" section there is an example = to >>>>>> backup databases by a simple [copyfile]: >>>>>> http://www.webdna.us/page.dna?numero=3D54 >>>>>> ?? Does the example Lock the databases while being copied or is it >>>>>> assumed the databases are not currently in use? >>>>>> >>>>>> I've previously had 2 physical servers running using Gluster in ou= r >>>>>> DMZ. I want to only have one physical machine running and having >>>>>> backups or synched copies of the site and databases reside on a NA= S or >>>>>> a server within our LAN. >>>>>> >>>>>> Thanks! >>>>> --------------------------------------------------------- >>>>> This message is sent to you because you are subscribed to >>>>> the mailing list talk@webdna.us >>>>> To unsubscribe, E-mail to: talk-leave@webdna.us >>>>> archives: http://www.webdna.us/page.dna?numero=3D55 >>>>> Bug Reporting: support@webdna.us >>>> --=20 >>>> Steve Raslevich >>>> --------------------------------------------------------- >>>> This message is sent to you because you are subscribed to >>>> the mailing list talk@webdna.us >>>> To unsubscribe, E-mail to: talk-leave@webdna.us >>>> archives: http://www.webdna.us/page.dna?numero=3D55 >>>> Bug Reporting: support@webdna.us >>> --------------------------------------------------------- >>> This message is sent to you because you are subscribed to >>> the mailing list talk@webdna.us >>> To unsubscribe, E-mail to: talk-leave@webdna.us >>> archives: http://www.webdna.us/page.dna?numero=3D55 >>> Bug Reporting: support@webdna.us >> --------------------------------------------------------- >> This message is sent to you because you are subscribed to >> the mailing list talk@webdna.us >> To unsubscribe, E-mail to: talk-leave@webdna.us >> archives: http://www.webdna.us/page.dna?numero=3D55 >> Bug Reporting: support@webdna.us > --------------------------------------------------------- > This message is sent to you because you are subscribed to > the mailing list talk@webdna.us > To unsubscribe, E-mail to: talk-leave@webdna.us > archives: http://www.webdna.us/page.dna?numero=3D55 > Bug Reporting: support@webdna.us --=20 Steve Raslevich --------------------------------------------------------- This message is sent to you because you are subscribed to the mailing list talk@webdna.us To unsubscribe, E-mail to: talk-leave@webdna.us archives: http://www.webdna.us/page.dna?numero=3D55 Bug Reporting: support@webdna.us .
webdna
DOWNLOAD WEBDNA NOW!
Top Articles:
Talk List
The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...
Related Readings:
Sorry WebCat server not running (2001)
webcat method for waiting specific amount of time? (2000)
possible, WebCat2.0 and checkboxes-restated (1997)
Where's Cart Created ? (1997)
WebCat2 several catalogs? (1997)
What is your question??? (2003)
Logout? (1998)
Webcat/Webmerchant part II (1998)
Variables for chat (1997)
Help name our technology! (1997)
Secure server question (1997)
bug? template caching and apache transfer byte log (1999)
Setting up the server (1997)
Missing from Docs [folderName] (1997)
Most Recent version of WebDNA For RH ES (2006)
Comments in db? (1997)
[WebDNA] Anyone use this coding style for readability... (2010)
[WebDNA] WebDNA receiving numerous signal SIGSEGV then crashing (2016)
emailer (1997)
For those of you not on the WebCatalog Beta... (1997)