[WebDNA] NoSQL: sharing some ideas

This WebDNA talk-list message is from

2013


It keeps the original formatting.
numero = 110953
interpreted = N
texte = --Apple-Mail=_56BD761A-D14E-4D95-916A-BC713E18E462 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=windows-1252 Sharing some ideas=85 I was reading about NoSQL. Interactive applications have changed dramatically over the last 15 = years, and so have the data management needs of those apps. Today, NoSQL = is increasingly considered a viable alternative to relational databases, = especially as more organizations recognize that operating at scale is = better achieved on clusters of standard, commodity servers, and a = schema-less data model is often better for the variety and type of data = captured and processed today. Today, most new applications (both consumer and business) use a = three-tier Internet architecture, run in a public or private cloud, and = support large numbers of users. At the database tier, relational databases were originally the popular = choice. Their use was increasingly problematic however, because they are = a centralized, share-everything technology that scales up rather than = out. This made them a poor fit for applications that require easy and = dynamic scalability. NoSQL databases have been built from the ground up = to be distributed, scale-out technologies and therefore fit better with = the highly distributed nature of the three-tier Internet architecture. Relational and NoSQL data models are very different. The relational = model takes data and separates it into many interrelated tables that = contain rows and columns. Tables reference each other through foreign = keys that are stored in columns as well. When looking up data, the = desired information needs to be collected from many tables (often = hundreds in today=92s enterprise applications) and combined before it = can be provided to the application. Similarly, when writing data, the = write needs to be coordinated and performed on many tables. WebDNA has all the tools to build basic NoSQL databases: [appendfile], [deletefile], [writefile], [createfolder], [include] = etc... Basically, storing data in "NoSQL format" writes XML or JSON (or not) = formatted files, one file per record. If the files are text files, then = they are fully transportable, whatever the platform, a cloud storage = being ideal. WebDNA databases as we know them just record an index of = these files and few more data, whatever we want, and the place of the = file, whatever the disk, whatever the server. It is not even necessary = to keep all the files on the same server or in the same data center. It = is fully scalable. I built my first NoSQL database in 2000 with WebDNA, without even = knowing how to name it. It was a invoicing system and customers had to = be able to recover their invoices online. Invoices were just text files, = included into a design frame, with an index in a WebDNA database. As of today, the frame design changed, the platform changed three times = and is now hosted in a cloud, and there are 385,962 invoices devided in = about 100 directories. WebDNA index keeps track of the files names and = paths as well as few other informations, but the WebDNA indexing = database takes less than 13MB. Searching for an old invoice takes = miliseconds. The cloud offers high availability and load sharing=85 - chris --Apple-Mail=_56BD761A-D14E-4D95-916A-BC713E18E462 Content-Disposition: attachment; filename=smime.p7s Content-Type: application/pkcs7-signature; name=smime.p7s Content-Transfer-Encoding: base64 MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIFRDCCBUAw ggQooAMCAQICEQDFbZXOe/tmBQPtCFqj0aAHMA0GCSqGSIb3DQEBBQUAMIGTMQswCQYDVQQGEwJH QjEbMBkGA1UECBMSR3JlYXRlciBNYW5jaGVzdGVyMRAwDgYDVQQHEwdTYWxmb3JkMRowGAYDVQQK ExFDT01PRE8gQ0EgTGltaXRlZDE5MDcGA1UEAxMwQ09NT0RPIENsaWVudCBBdXRoZW50aWNhdGlv biBhbmQgU2VjdXJlIEVtYWlsIENBMB4XDTEzMDgxODAwMDAwMFoXDTE0MDgxODIzNTk1OVowMDEu MCwGCSqGSIb3DQEJARYfY2hyaXN0b3BoZS5iaWxsaW90dGV0QHdlYmRuYS51czCCASIwDQYJKoZI hvcNAQEBBQADggEPADCCAQoCggEBAO93Fui94Ico9o81FVnISpmdw/yKmd3s1HNY9v+NQGlNOzMg 6XYjuvSepfX4tmXhfid401iK9tuJT2yupu918FbeI5HdG3s5NWOUdABqb4z61g8H8yGsqFwaLlDk mBgI1DE4whCX/e+3E4CVl/6YfK7S5rWd2Ia/4K/s8GdGJNJCZOjaqteHAZZvC90RIdB2NCgZ2rbZ DSLVS2f9NfLp+rX0PVBmol9fIXC+AtmNLFR8FhTw5iQrQCcKkxaz82AEGbQv5viz5rfQG4tCGqQJ 71bSo0+JynuYIgn4KJNfcX0QMjJ3Fe7AlSRnnMF3m1k+uoR44i6F3sBY23wmfxNrK/8CAwEAAaOC Ae8wggHrMB8GA1UdIwQYMBaAFHoTTgB0W8Z4Y2QnwS/ioFu8ecV7MB0GA1UdDgQWBBRO7fSdNIXh i9FJa1vqp12NuXl8PTAOBgNVHQ8BAf8EBAMCBaAwDAYDVR0TAQH/BAIwADAgBgNVHSUEGTAXBggr BgEFBQcDBAYLKwYBBAGyMQEDBQIwEQYJYIZIAYb4QgEBBAQDAgUgMEYGA1UdIAQ/MD0wOwYMKwYB BAGyMQECAQEBMCswKQYIKwYBBQUHAgEWHWh0dHBzOi8vc2VjdXJlLmNvbW9kby5uZXQvQ1BTMFcG A1UdHwRQME4wTKBKoEiGRmh0dHA6Ly9jcmwuY29tb2RvY2EuY29tL0NPTU9ET0NsaWVudEF1dGhl bnRpY2F0aW9uYW5kU2VjdXJlRW1haWxDQS5jcmwwgYgGCCsGAQUFBwEBBHwwejBSBggrBgEFBQcw AoZGaHR0cDovL2NydC5jb21vZG9jYS5jb20vQ09NT0RPQ2xpZW50QXV0aGVudGljYXRpb25hbmRT ZWN1cmVFbWFpbENBLmNydDAkBggrBgEFBQcwAYYYaHR0cDovL29jc3AuY29tb2RvY2EuY29tMCoG A1UdEQQjMCGBH2NocmlzdG9waGUuYmlsbGlvdHRldEB3ZWJkbmEudXMwDQYJKoZIhvcNAQEFBQAD ggEBABnxNy9MQe+JW8++bsQBGoMEDFwr1SpYH45cZWkuulj3kRiGM+4uz1DLpSsr/3GjFz8WAHhG jwaAlB0WpmWfYzjh+IUkRfQqiwMKdgBd+bDKVWE6asZKn406sdvgt10IFW+Vs6drYDqe+iVFxYYO AdU71S+Q9YWgVrtg5fUgDk3iruDsRnM1nrgI2hCSUmgb6oWLEi50NGuxBN2vC/ZSTn/Ptj1IP9Xs V9F+SlZRsc3qfaRnr67XIkpjfg/PRfNg7l4CZm4ceDHr7ZpfG5tWU2tPKcrBA2HIopmch1Sqd48r /EZ2Z2h7nSqY3M8LBQnybTa8sNb8+8SllARs2DdcP0AxggOuMIIDqgIBATCBqTCBkzELMAkGA1UE BhMCR0IxGzAZBgNVBAgTEkdyZWF0ZXIgTWFuY2hlc3RlcjEQMA4GA1UEBxMHU2FsZm9yZDEaMBgG A1UEChMRQ09NT0RPIENBIExpbWl0ZWQxOTA3BgNVBAMTMENPTU9ETyBDbGllbnQgQXV0aGVudGlj YXRpb24gYW5kIFNlY3VyZSBFbWFpbCBDQQIRAMVtlc57+2YFA+0IWqPRoAcwCQYFKw4DAhoFAKCC AdkwGAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMTMxMjA0MTEwMjMw WjAjBgkqhkiG9w0BCQQxFgQUO4lrMZDQnYAJGSWhjjFY+797Lv4wgboGCSsGAQQBgjcQBDGBrDCB qTCBkzELMAkGA1UEBhMCR0IxGzAZBgNVBAgTEkdyZWF0ZXIgTWFuY2hlc3RlcjEQMA4GA1UEBxMH U2FsZm9yZDEaMBgGA1UEChMRQ09NT0RPIENBIExpbWl0ZWQxOTA3BgNVBAMTMENPTU9ETyBDbGll bnQgQXV0aGVudGljYXRpb24gYW5kIFNlY3VyZSBFbWFpbCBDQQIRAMVtlc57+2YFA+0IWqPRoAcw gbwGCyqGSIb3DQEJEAILMYGsoIGpMIGTMQswCQYDVQQGEwJHQjEbMBkGA1UECBMSR3JlYXRlciBN YW5jaGVzdGVyMRAwDgYDVQQHEwdTYWxmb3JkMRowGAYDVQQKExFDT01PRE8gQ0EgTGltaXRlZDE5 MDcGA1UEAxMwQ09NT0RPIENsaWVudCBBdXRoZW50aWNhdGlvbiBhbmQgU2VjdXJlIEVtYWlsIENB AhEAxW2Vznv7ZgUD7Qhao9GgBzANBgkqhkiG9w0BAQEFAASCAQAOKWOSKiYv9cka0dK2+oSsofaK Jj99SSyLloqcXCYMWmA3j0bR40QYzRRnuboAkOmlj7ODqaGT3TJTi/cfumtoSg7AtAQpboV9etEh xsNHgdMtwQAFVsFVxRx7ClX6M343e/3/4+zqV1HoX32boA4whAlWig7MlU+Efn1AbLNFr2AKZ5vN dTr8+vxxlZkXjvMiyKjAbmJv2fIQXUu6Ka474WnkkaPtjHCPw6MjRj4crwes3gvzAa42Q2q+ytPV 9Aak3p3K9PU9f35QbBPE+g4kF/08ppxZsftkGGI+iCFk2YgkwFIyTJ786D89UQQIn5QlUMYI4A6w r1Zzzs8180vnAAAAAAAA --Apple-Mail=_56BD761A-D14E-4D95-916A-BC713E18E462-- Associated Messages, from the most recent to the oldest:

    
  1. Re: [WebDNA] NoSQL: sharing some ideas (Terry Wilson 2013)
  2. Re: [WebDNA] NoSQL: sharing some ideas (christophe.billiottet@webdna.us 2013)
  3. RE: [WebDNA] NoSQL: sharing some ideas ("Terry Nair" 2013)
  4. [WebDNA] NoSQL: sharing some ideas (christophe.billiottet@webdna.us 2013)
--Apple-Mail=_56BD761A-D14E-4D95-916A-BC713E18E462 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=windows-1252 Sharing some ideas=85 I was reading about NoSQL. Interactive applications have changed dramatically over the last 15 = years, and so have the data management needs of those apps. Today, NoSQL = is increasingly considered a viable alternative to relational databases, = especially as more organizations recognize that operating at scale is = better achieved on clusters of standard, commodity servers, and a = schema-less data model is often better for the variety and type of data = captured and processed today. Today, most new applications (both consumer and business) use a = three-tier Internet architecture, run in a public or private cloud, and = support large numbers of users. At the database tier, relational databases were originally the popular = choice. Their use was increasingly problematic however, because they are = a centralized, share-everything technology that scales up rather than = out. This made them a poor fit for applications that require easy and = dynamic scalability. NoSQL databases have been built from the ground up = to be distributed, scale-out technologies and therefore fit better with = the highly distributed nature of the three-tier Internet architecture. Relational and NoSQL data models are very different. The relational = model takes data and separates it into many interrelated tables that = contain rows and columns. Tables reference each other through foreign = keys that are stored in columns as well. When looking up data, the = desired information needs to be collected from many tables (often = hundreds in today=92s enterprise applications) and combined before it = can be provided to the application. Similarly, when writing data, the = write needs to be coordinated and performed on many tables. WebDNA has all the tools to build basic NoSQL databases: [appendfile], [deletefile], [writefile], [createfolder], [include] = etc... Basically, storing data in "NoSQL format" writes XML or JSON (or not) = formatted files, one file per record. If the files are text files, then = they are fully transportable, whatever the platform, a cloud storage = being ideal. WebDNA databases as we know them just record an index of = these files and few more data, whatever we want, and the place of the = file, whatever the disk, whatever the server. It is not even necessary = to keep all the files on the same server or in the same data center. It = is fully scalable. I built my first NoSQL database in 2000 with WebDNA, without even = knowing how to name it. It was a invoicing system and customers had to = be able to recover their invoices online. Invoices were just text files, = included into a design frame, with an index in a WebDNA database. As of today, the frame design changed, the platform changed three times = and is now hosted in a cloud, and there are 385,962 invoices devided in = about 100 directories. WebDNA index keeps track of the files names and = paths as well as few other informations, but the WebDNA indexing = database takes less than 13MB. Searching for an old invoice takes = miliseconds. The cloud offers high availability and load sharing=85 - chris --Apple-Mail=_56BD761A-D14E-4D95-916A-BC713E18E462 Content-Disposition: attachment; filename=smime.p7s Content-Type: application/pkcs7-signature; name=smime.p7s Content-Transfer-Encoding: base64 MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIFRDCCBUAw ggQooAMCAQICEQDFbZXOe/tmBQPtCFqj0aAHMA0GCSqGSIb3DQEBBQUAMIGTMQswCQYDVQQGEwJH QjEbMBkGA1UECBMSR3JlYXRlciBNYW5jaGVzdGVyMRAwDgYDVQQHEwdTYWxmb3JkMRowGAYDVQQK ExFDT01PRE8gQ0EgTGltaXRlZDE5MDcGA1UEAxMwQ09NT0RPIENsaWVudCBBdXRoZW50aWNhdGlv biBhbmQgU2VjdXJlIEVtYWlsIENBMB4XDTEzMDgxODAwMDAwMFoXDTE0MDgxODIzNTk1OVowMDEu MCwGCSqGSIb3DQEJARYfY2hyaXN0b3BoZS5iaWxsaW90dGV0QHdlYmRuYS51czCCASIwDQYJKoZI hvcNAQEBBQADggEPADCCAQoCggEBAO93Fui94Ico9o81FVnISpmdw/yKmd3s1HNY9v+NQGlNOzMg 6XYjuvSepfX4tmXhfid401iK9tuJT2yupu918FbeI5HdG3s5NWOUdABqb4z61g8H8yGsqFwaLlDk mBgI1DE4whCX/e+3E4CVl/6YfK7S5rWd2Ia/4K/s8GdGJNJCZOjaqteHAZZvC90RIdB2NCgZ2rbZ DSLVS2f9NfLp+rX0PVBmol9fIXC+AtmNLFR8FhTw5iQrQCcKkxaz82AEGbQv5viz5rfQG4tCGqQJ 71bSo0+JynuYIgn4KJNfcX0QMjJ3Fe7AlSRnnMF3m1k+uoR44i6F3sBY23wmfxNrK/8CAwEAAaOC Ae8wggHrMB8GA1UdIwQYMBaAFHoTTgB0W8Z4Y2QnwS/ioFu8ecV7MB0GA1UdDgQWBBRO7fSdNIXh i9FJa1vqp12NuXl8PTAOBgNVHQ8BAf8EBAMCBaAwDAYDVR0TAQH/BAIwADAgBgNVHSUEGTAXBggr BgEFBQcDBAYLKwYBBAGyMQEDBQIwEQYJYIZIAYb4QgEBBAQDAgUgMEYGA1UdIAQ/MD0wOwYMKwYB BAGyMQECAQEBMCswKQYIKwYBBQUHAgEWHWh0dHBzOi8vc2VjdXJlLmNvbW9kby5uZXQvQ1BTMFcG A1UdHwRQME4wTKBKoEiGRmh0dHA6Ly9jcmwuY29tb2RvY2EuY29tL0NPTU9ET0NsaWVudEF1dGhl bnRpY2F0aW9uYW5kU2VjdXJlRW1haWxDQS5jcmwwgYgGCCsGAQUFBwEBBHwwejBSBggrBgEFBQcw AoZGaHR0cDovL2NydC5jb21vZG9jYS5jb20vQ09NT0RPQ2xpZW50QXV0aGVudGljYXRpb25hbmRT ZWN1cmVFbWFpbENBLmNydDAkBggrBgEFBQcwAYYYaHR0cDovL29jc3AuY29tb2RvY2EuY29tMCoG A1UdEQQjMCGBH2NocmlzdG9waGUuYmlsbGlvdHRldEB3ZWJkbmEudXMwDQYJKoZIhvcNAQEFBQAD ggEBABnxNy9MQe+JW8++bsQBGoMEDFwr1SpYH45cZWkuulj3kRiGM+4uz1DLpSsr/3GjFz8WAHhG jwaAlB0WpmWfYzjh+IUkRfQqiwMKdgBd+bDKVWE6asZKn406sdvgt10IFW+Vs6drYDqe+iVFxYYO AdU71S+Q9YWgVrtg5fUgDk3iruDsRnM1nrgI2hCSUmgb6oWLEi50NGuxBN2vC/ZSTn/Ptj1IP9Xs V9F+SlZRsc3qfaRnr67XIkpjfg/PRfNg7l4CZm4ceDHr7ZpfG5tWU2tPKcrBA2HIopmch1Sqd48r /EZ2Z2h7nSqY3M8LBQnybTa8sNb8+8SllARs2DdcP0AxggOuMIIDqgIBATCBqTCBkzELMAkGA1UE BhMCR0IxGzAZBgNVBAgTEkdyZWF0ZXIgTWFuY2hlc3RlcjEQMA4GA1UEBxMHU2FsZm9yZDEaMBgG A1UEChMRQ09NT0RPIENBIExpbWl0ZWQxOTA3BgNVBAMTMENPTU9ETyBDbGllbnQgQXV0aGVudGlj YXRpb24gYW5kIFNlY3VyZSBFbWFpbCBDQQIRAMVtlc57+2YFA+0IWqPRoAcwCQYFKw4DAhoFAKCC AdkwGAYJKoZIhvcNAQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMTMxMjA0MTEwMjMw WjAjBgkqhkiG9w0BCQQxFgQUO4lrMZDQnYAJGSWhjjFY+797Lv4wgboGCSsGAQQBgjcQBDGBrDCB qTCBkzELMAkGA1UEBhMCR0IxGzAZBgNVBAgTEkdyZWF0ZXIgTWFuY2hlc3RlcjEQMA4GA1UEBxMH U2FsZm9yZDEaMBgGA1UEChMRQ09NT0RPIENBIExpbWl0ZWQxOTA3BgNVBAMTMENPTU9ETyBDbGll bnQgQXV0aGVudGljYXRpb24gYW5kIFNlY3VyZSBFbWFpbCBDQQIRAMVtlc57+2YFA+0IWqPRoAcw gbwGCyqGSIb3DQEJEAILMYGsoIGpMIGTMQswCQYDVQQGEwJHQjEbMBkGA1UECBMSR3JlYXRlciBN YW5jaGVzdGVyMRAwDgYDVQQHEwdTYWxmb3JkMRowGAYDVQQKExFDT01PRE8gQ0EgTGltaXRlZDE5 MDcGA1UEAxMwQ09NT0RPIENsaWVudCBBdXRoZW50aWNhdGlvbiBhbmQgU2VjdXJlIEVtYWlsIENB AhEAxW2Vznv7ZgUD7Qhao9GgBzANBgkqhkiG9w0BAQEFAASCAQAOKWOSKiYv9cka0dK2+oSsofaK Jj99SSyLloqcXCYMWmA3j0bR40QYzRRnuboAkOmlj7ODqaGT3TJTi/cfumtoSg7AtAQpboV9etEh xsNHgdMtwQAFVsFVxRx7ClX6M343e/3/4+zqV1HoX32boA4whAlWig7MlU+Efn1AbLNFr2AKZ5vN dTr8+vxxlZkXjvMiyKjAbmJv2fIQXUu6Ka474WnkkaPtjHCPw6MjRj4crwes3gvzAa42Q2q+ytPV 9Aak3p3K9PU9f35QbBPE+g4kF/08ppxZsftkGGI+iCFk2YgkwFIyTJ786D89UQQIn5QlUMYI4A6w r1Zzzs8180vnAAAAAAAA --Apple-Mail=_56BD761A-D14E-4D95-916A-BC713E18E462-- christophe.billiottet@webdna.us

DOWNLOAD WEBDNA NOW!

Top Articles:

Talk List

The WebDNA community talk-list is the best place to get some help: several hundred extremely proficient programmers with an excellent knowledge of WebDNA and an excellent spirit will deliver all the tips and tricks you can imagine...

Related Readings:

looking for some paid WebCatalog help (2000) Middle problem (2005) Bug alert! (1997) sort problems....bug or brain fart? (1997) WebCat2 beta 11 - new prefs ... (1997) old mail...problem with listserv? (1998) referrer usage (1997) Re:WebDNA made easier? (1998) BGcolor (1997) My slower response (1997) WebDNA Solutions ... sorry! (1997) Keyword search (2004) So what ya working on? (or have you completed?) (2004) WebCat2b12 - nesting [tags] (1997) extending webcatalog (1997) [WriteFile] problems (1997) Need relative path explanation (1997) Is WebCat 3.0 necessary for calculating shipping? (2000) [WebDNA] Another strange WebDNA problem (2013) Bug Report, maybe (1997)