well I lost everything on my server

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • Curious.George
    Badcaps Legend
    • Nov 2011
    • 2305
    • Unknown

    #41
    Re: well I lost everything on my server

    Originally posted by sofTest
    Nope, one do not design storage systems based on information on need for storage capacity alone. But you wouldn't know that. But I'm not going to waste more time on this. Based on what you have proven not knowing above, and other wild claims, I'm sorry to say that I'm leaning more toward you trolling than credible.
    (sigh) Sad little person. You've obviously not considered the consequences of your decisions. Fear not, life will teach you these lessons! You'll remember this discussion and be even angrier at me when you realize the prophecy!

    Ask yourself how you're going to increase your storage capacity: copy everything off the ZFS onto ???; tear down your vdevs, add another drive and then rebuild everything and copy everything back? Or, replace drives, one at a time in each vdev with larger drives, resilver and then then let the pool expand? Discard the old (now too small) drives? Add a second vdev (3 more drives) -- if the hardware can support it? Add a second box with a different configuration (components of which will be useless as spares for the first box; and vice versa).

    You may not have 100T now. But, once you start getting used to having "unlimited storage" you'll discover that you use it, fast. With ZFS/RAID, all of the data is spinning at any given time. So, it's all AT RISK. A careless keystroke, a catastrophic hardware failure, a bug in the software, etc.

    (So, just keep duplicates of EVERY box that you have as insurance! )

    I add new drives just by plugging them in (unplugging something that isn't CURRENTLY being used). I keep 1, 2 or 30 copies of files as I see fit. They can reside on the same volumes or on N different ones -- in any combination. They can have different names and reside in different directories across volumes -- beyond even the capacity of symlinks to map equivalences!

    I can mail a medium to a client and he can read/write it at his leisure. When it comes back to me, I can see what (if anything) has been changed. I can store any portion of my archive offsite on as many volumes as I see fit (including just one). A client can mail me a volume and I can import it to my archive "as is" -- so, when he refers to "/projects/2010/summer/proposals/blah" I'll be able to directly and unambiguously access it.

    I can access it via Solaris, Windows (XP, Vista, 7, 8, 10 -- even 95/98 with USB support), Linux, MacOSX -- or even a thin client with just 100MB of RAM (and no display!). I can upgrade any of these OS's and never put more than one volume at risk (to prove the integrity of the OS upgrade).

    I can browse my entire repository's namespace without mounting ANY volumes. I can create a new volume drawing files from any number of volumes. I can create volumes on R/O media. I can do this on a laptop without AC mains being available.

    I can FREELY incorporate volumes of different types, technologies and interfaces (SCA/FC-AL/SCSI/SATA/PATA/floppy/memory card/etc.). I can export an NFS/SMB share and treat it as part of the archive -- verifying its integrity or automatically "reinitializing it" (mark it as corrupt) with the "backup originals" from the rest of the archive.

    I don't need special tools to do any of them (other than some SQL scripts and the ability to mount volumes in whatever way the host OS desires). So, I don't have to worry about updates to those tools "breaking things" or putting the entire archive at risk.

    You can do all of those things with ZFS, right?

    In your professional capacity , address the "hypothetical" client with 100T of storage doubling every 3-4 years. How should he ensure he can access old tax records (in the UNLIKELY event of an audit), old sales histories (when proposing a new product), old development costs (when budgeting the development effort for that new product), etc. Be sure to tell him what sort of equipment he should expect to buy and what sort of staff (and labor costs) he should be prepared to encounter in order to maintain that data. Prepare a budget of the hardware maintenance costs for the foreseeable future (how long before those drives fail? How much money and time to replace?

    I'll gladly present your recommendations to MY clients -- as EXPERT ADVICE. So, be sure to reflect all the costs/benefits in your proposal.

    Or, are you a one-trick pony? Would you have advocated building an addition on the corporate office to hold more FILE CABINETS to keep ALL of the companies records "accessible" -- despite the age or value thereof -- instead of moving old stuff to "secondary storage"? Sure sounds like it!

    To mimic your comments, based on how evasive you have been over real issues (you haven't even disclosed the size of your array, number of objects it contains, the hardware its running on, your costs to implement/maintain, etc.) and other wild claims, I'm sorry to say that I'm leaning more toward you being a simple ZFS fanboi rather than credible.

    [or, having sorely limited experience "in the wild"... ever work for a company with 10 employees? 100? 1000? 100000? If you have, you'll know that the way problems are solved varies greatly, as do the resources available to throw at problems! Hint: I've worked at or for all of the above and had to come up with solutions that "made sense" to each of them]

    I'll respond when you've proposed a solution that I'll gladly pass by real clients for their unbiased opinions. I'm sure the big companies with systems in place will be EAGER (not!) to adopt your solution. As will the companies with no IT departments.

    Comment

    • sofTest
      Badcaps Veteran
      • Aug 2008
      • 361

      #42
      Re: well I lost everything on my server

      Originally posted by Curious.George
      (sigh) Sad little person. You've obviously not considered the consequences of your decisions. Fear not, life will teach you these lessons! You'll remember this discussion and be even angrier at me when you realize the prophecy!

      Ask yourself how you're going to increase your storage capacity: copy everything off the ZFS onto ???; tear down your vdevs, add another drive and then rebuild everything and copy everything back? Or, replace drives, one at a time in each vdev with larger drives, resilver and then then let the pool expand? Discard the old (now too small) drives? Add a second vdev (3 more drives) -- if the hardware can support it? Add a second box with a different configuration (components of which will be useless as spares for the first box; and vice versa).

      You may not have 100T now. But, once you start getting used to having "unlimited storage" you'll discover that you use it, fast. With ZFS/RAID, all of the data is spinning at any given time. So, it's all AT RISK. A careless keystroke, a catastrophic hardware failure, a bug in the software, etc.

      (So, just keep duplicates of EVERY box that you have as insurance! )

      I add new drives just by plugging them in (unplugging something that isn't CURRENTLY being used). I keep 1, 2 or 30 copies of files as I see fit. They can reside on the same volumes or on N different ones -- in any combination. They can have different names and reside in different directories across volumes -- beyond even the capacity of symlinks to map equivalences!

      I can mail a medium to a client and he can read/write it at his leisure. When it comes back to me, I can see what (if anything) has been changed. I can store any portion of my archive offsite on as many volumes as I see fit (including just one). A client can mail me a volume and I can import it to my archive "as is" -- so, when he refers to "/projects/2010/summer/proposals/blah" I'll be able to directly and unambiguously access it.

      I can access it via Solaris, Windows (XP, Vista, 7, 8, 10 -- even 95/98 with USB support), Linux, MacOSX -- or even a thin client with just 100MB of RAM (and no display!). I can upgrade any of these OS's and never put more than one volume at risk (to prove the integrity of the OS upgrade).

      I can browse my entire repository's namespace without mounting ANY volumes. I can create a new volume drawing files from any number of volumes. I can create volumes on R/O media. I can do this on a laptop without AC mains being available.

      I can FREELY incorporate volumes of different types, technologies and interfaces (SCA/FC-AL/SCSI/SATA/PATA/floppy/memory card/etc.). I can export an NFS/SMB share and treat it as part of the archive -- verifying its integrity or automatically "reinitializing it" (mark it as corrupt) with the "backup originals" from the rest of the archive.

      I don't need special tools to do any of them (other than some SQL scripts and the ability to mount volumes in whatever way the host OS desires). So, I don't have to worry about updates to those tools "breaking things" or putting the entire archive at risk.

      You can do all of those things with ZFS, right?

      In your professional capacity , address the "hypothetical" client with 100T of storage doubling every 3-4 years. How should he ensure he can access old tax records (in the UNLIKELY event of an audit), old sales histories (when proposing a new product), old development costs (when budgeting the development effort for that new product), etc. Be sure to tell him what sort of equipment he should expect to buy and what sort of staff (and labor costs) he should be prepared to encounter in order to maintain that data. Prepare a budget of the hardware maintenance costs for the foreseeable future (how long before those drives fail? How much money and time to replace?

      I'll gladly present your recommendations to MY clients -- as EXPERT ADVICE. So, be sure to reflect all the costs/benefits in your proposal.

      Or, are you a one-trick pony? Would you have advocated building an addition on the corporate office to hold more FILE CABINETS to keep ALL of the companies records "accessible" -- despite the age or value thereof -- instead of moving old stuff to "secondary storage"? Sure sounds like it!

      To mimic your comments, based on how evasive you have been over real issues (you haven't even disclosed the size of your array, number of objects it contains, the hardware its running on, your costs to implement/maintain, etc.) and other wild claims, I'm sorry to say that I'm leaning more toward you being a simple ZFS fanboi rather than credible.

      [or, having sorely limited experience "in the wild"... ever work for a company with 10 employees? 100? 1000? 100000? If you have, you'll know that the way problems are solved varies greatly, as do the resources available to throw at problems! Hint: I've worked at or for all of the above and had to come up with solutions that "made sense" to each of them]

      I'll respond when you've proposed a solution that I'll gladly pass by real clients for their unbiased opinions. I'm sure the big companies with systems in place will be EAGER (not!) to adopt your solution. As will the companies with no IT departments.
      Yupp, trolling.^
      ------------
      Be a mensch

      Comment

      • Curious.George
        Badcaps Legend
        • Nov 2011
        • 2305
        • Unknown

        #43
        Re: well I lost everything on my server

        Originally posted by sofTest
        Yupp, trolling.^
        ^Yup, incompetent.

        (amazing how when forced to stand by your words, you run and hide... I guess even YOU don't believe what you're saying!)

        Bye, bye, little person!

        Comment

        • sofTest
          Badcaps Veteran
          • Aug 2008
          • 361

          #44
          Re: well I lost everything on my server

          Originally posted by Curious.George
          ^Yup, incompetent.

          (amazing how when forced to stand by your words, you run and hide... I guess even YOU don't believe what you're saying!)

          Bye, bye, little person!
          Forced to stand by my words? My only claim from the start has been that it is not usually not hard to move a software RAID. I have not solicited people, not even you, to use any kind of storage solution. You on the other hand has repeatedly and boringly droned on about your magnificent shelf stores, under ways making several incompetent claims about ZFS. Then you are trying to draw me out on "designing" a storage system, despite I clearly has stated before that your data, your problem, not interested. Then you want information about my system, despite I clearly said before, none of your business. You sir, are simply a repetitive boring troll, and I'm simply to old to play.
          ------------
          Be a mensch

          Comment

          • momaka
            master hoarder
            • May 2008
            • 12164
            • Bulgaria

            #45
            Re: well I lost everything on my server

            So back to the original topic in hand...

            Uranium, does that mean the entire electrolytic capacitor data sheet database is gone too? :\
            I hope not, and it would be a shame if it is. But I guess these things happen.

            Good thing I kind of keep my own "database" of cap data sheets.

            Similar to Curious.George's, I forgo the whole RAID/ZFS stuff and just keep copies onto random PCs, spare HDDs, Flash drivers, and DVDs/CDs (but much MUCH less elaborate and more manual/not automated compared to his, if it can even be compared ).

            I'm actually pretty messy about my backups. Some files I have backed up in over 6 places (again, different PCs with different HDDs/interfaces and OSes, CDs, and flash drives), and some files I have only in one or two backup HDDs. It all depends how important the files are to me. Things like my pictures collection is well backed up: it exists on my main PC, a backup (portable) HDD, my laptop (which is also portable, sort of ), and another PC in my uncle's house in an entirely different continent. I also have partial backups of that collection in various PCs I've used over the years before that (partial, because at some point these PCs were my main PCs, and that means at some point they were the "original" copy/backup before I retired them).

            So all in all, even a major wipe out will still likely leave me with *most* (if not all) of my data intact. Because of the messy way I've backed up things, of course, retrieving some files back will be a pain in the butt, if I happen to need them again. But nothing lasts forever, so whatever!
            Last edited by momaka; 08-02-2018, 02:28 PM.

            Comment

            • Uranium-235
              Comrade Glimmer
              • Aug 2007
              • 5042
              • US

              #46
              Re: well I lost everything on my server

              the cap db is hosted on a 1und1 account (I say und because it's a german company :P)

              I might get another TB drive in there to do monthly backups to. I've been reading on commands to spindown/spinup drives, so I might make a script to spinup (which I think can be done just by mounting), backup, mark spindown time as short, and unmount it

              or get an Esata -> Sata bracket, and put the drive in an enclosure with an esata port and hotswap it, power off, so it's not exposed to possible power fluxuations, and I can keep the backup schedule on my time
              Cap Datasheet Depot: http://www.paullinebarger.net/DS/
              ^If you have datasheets not listed PM me

              Comment

              Related Topics

              Collapse

              • omega
                Troubleshooting of redundant F750E-S0 Dell PowerEdge Server
                by omega
                Hello all,
                as a beginner electronics hobbyist, after a few years I would like to place another post on this Forum section, given that I did not succeed in finding any useful advice among the other posts.

                Over the last years, I have been using a PowerEdge Dell Server with two redundant PSUs, namely the 750W F750E-S0 ones (aka 06W2PW). Unfortunately, last summer one of them failed (perhaps owing to an overheating), and the server had for working to take into account the other one only. Of course I opened and tried to troubleshoot the failed PSU, but each cap I tested seemed to...
                02-09-2024, 03:34 PM
              • Document Archive
                HP ZBook 15v G5 Mobile server 15v Specification for Upgrade or Repair
                by Document Archive
                This specification for the HP ZBook 15v G5 Mobile server can be useful for upgrading or repairing a laptop that is not working. As a community we are working through our specifications to add valuable data like the 15v G5 boardview and 15v G5 schematic. Our users have donated over 1 million documents which are being added to the site. This page will be updated soon with additional information. Alternatively you can request additional help from our users directly on the relevant badcaps forum. Please note that we offer no warranties that any specification, datasheet, or download for HP ZBook 15v...
                09-06-2024, 11:39 AM
              • harp
                Comparing FreeNAS, FTP server, SMB server, multimedia server...
                by harp
                I thinking about some central LAN file server, on where I can put some files from other devices, or access to them, and maybe play some movie without download...

                I never study this, but when I see that freenas need few gigabyte of ram to recommended working, some wiered partition, I wonder if I miss somewhat in the midletime...
                Also exist "turnkey file server", and other turnkey products that I can not distinguished what is major difference and how it perform - no experiance at all.

                What is general difference between this products, and what be most useful...
                01-04-2024, 02:44 PM
              • Fireballcz
                Windows 2016 server L2TP/IPsec VPN - two subnets
                by Fireballcz
                Hello, please how to properly configure VPN in this environment?
                I have two subnets in two different (geographical) workplaces, connected via IPsec (thru gateway routers)
                Main subnet: 192.168.11.0/24, gateway (router IP) 192.168.11.1, Windows 2016 server (VPN, DHCP, DC etc.) 192.168.11.3
                2nd subnet : 192.168.22.0/24, gateway (router IP) 192.168.22.1 - just client computers.

                I need to allow external (home office) users connect via VPN server (192.168.11.3) to the 2nd subnet (192.168.22.0/24) to their computers (via RDP).
                I have no problems with VPN connection...
                07-29-2022, 03:20 AM
              • ratdude747
                Server Upgrade?
                by ratdude747
                I'm pushing 5 years on my current server and I'm thinking it may be time for some sort of an upgrade.

                The main issue I'm having is random ATA errors locking the system up at the most inopportune times. Probably the PATA to SATA adapter (I have a few more NOS ones on the shelf I could toss at it) but honestly I'm thinking an old "early" socket 940 board is a retro rig in 2023 and ough to be retired.

                The question for me is how much of an upgrade should I shoot for? The main issue I have to deal with is if I keep my chassis, the backplane is 16x SATA. Not SAS....
                01-31-2023, 05:49 PM
              • Loading...
              • No more items.
              Working...